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THE MEASUREMENT OF SOCIAL INTELLIGENCE 1 



Mm 1 ' 1 status as a social animal has been recognized 
lor * long time. The prime requirement of satisfactory 
social existence is ability to establish relations with 
and to interact with others. The importance of such 
interaction is stressed by a variety of commentators 
on human life, ranging from songwriters to philosophers. 
A currently popular song proclaims the luck of "people 
who need people. " Many psychotherapists claim that 
personality evolves only as the result of human inter- 
action. Psychological existentialists hold the view that 
self awareness, consciousness of one's very existence, 
cannot exist in the absence of social stimulation. In 
maintaining life as a social being, a person must be able 
to predict the ways in which others will behave. In this 
regard, comprehension of the feelings and intentions of 
other people is particularly relevant. 

Distinp’iisning joy from rage is a simple task. But 
as man's social life becomes more complex, the dis- 
positional distinctions that have to be made become in- 
creasingly subtle. The finer the discrimination to be 
made about another's social behavior, the greater the 
social skill that is required. 

Common uense suggests that people vary in their 
ability to understand other people, and that aptitude of 
this kind is different from general intellectual ability. 
Yet despite their contributions to our increased knowl- 
edge of human perception, motivation, and learning, 
psychologists have not been able to demonstrate satis- 
factorily that there is an ability to judge the mental 
■titfli of others that is distinct from general or verbal 
intelligence. Certainly there have been no adequate 
measures of a person's ability to understand other 
people. 

The present study is an attempt (1) to demonstrate 
that there is a separate intelligence involved in under- 
standing other people, and (2) to provide reliable, 
construct-valid tests of this intelligence. 

Experimental vs. Individual- Differences Approach 

One name that has been given to the phenomenon of 
understanding other people is "social intelligence" 
(Thorndike, 1920). Oir continuing ignorance about the 
nature of a construct so labeled, however, is noteworthy. 
This ignorance cannot be attributed to a lack of research 
enthusiasm. 

A great deal of experimental energy has been ex- 
pended in studying the phenomenon variously labeled 
"social sensitivity, " "person cognition, " or "interper- 
sonal perception. " Despite these neologisms, we know 
little more today about how we understand other people 
than when we spoke of "empathy" or "woman's intuition. " 



This study was conducted by the Aptitudes Research 
Project at the University of Southern California under 
Cooperative Research Project 1976 with the Office of 
Education, U. S. Department of Health, Education, and 
Welfare. The ideas expressed here are our own, and 
do not necessarily reflect the views of thit agency. This 
material may be reproduced for any purpose of the 
United States Government. Among the authors, Guilford 
has served as Responsible Investigator and Director of 
the Project, O’Sullivan, as Study leader for the social- 
intelligence study, and deMille, as consultant during 
the early stages. 



Since the thirties, most of the research concerned 
with "the ability to judge people" has been experimen- 
telly oriented. The methods used in these studies vary 
from the rating or ranking of the personality traits of 
peers or other target persons (Vernon, 1933; Wolf & 
Murray, 1937; Norman, 1953; Taft, 1950) to "predic- 
tions" about happenings in others' lives, or guesses 
about their answers to items of a personality test (Gage, 
1952; Cline & Richards, I960). The results from per- 
sonality research of this sort have been largely contra-' 
dictory, and therefore confusing. None of these experi- 
menters has offered an operational definition of social 
intelligence that has been acceptable to more than a 
handful of social scientists. 

In the face of unimpressive experimental results, it 
is surprising that the individual-differences approach, 
which is employed in the present study, has been used 
so little in investigating how humans understand one 
another's feelings and motive*). Scant attention has 
been paid to the possibility of assessing individual dif- 
ferences in the ability to judge people in the same way 
that individual differences in other kinds of aptitudes 
have been measured. An individual-differences orienta- 
tion would seem to be a promising one, however. An ex- 
ample of the usefulness of this approach is the widely 
accepted operational definition of abstract intelligence, 
as measured by standardized IQ and factor -analytic 
tests. 

Several reasons may be suggested for the neglect 
of the individual-differences approach to social intel- 
ligence. One reason might be a difference in defini- 
tional emphasis. It is currently more popular to speak 
of "person perception" than of "social intelligence. " 
In studying social perception, the procedures used in 
other perceptual studies are employed. Group ten- 
dencies are observed; and similarities, ratherthan 
differences, among persons are sought. 

Other, more practical, explanations of the paucity 
of social-intelligence tests include difficulties in deter- 
mining the "right" answers to test items and in assessing 
the appropriateness of test items printed on paper. 
Considerations such as these will be treated later in this 
report. At this point, we will review the few studies 
that have attempted to develop social-intelligence tests, 
using the individual-differences approach. 

Related Research 

Earlier attempts at devising construct-valid tests 
of social intelligence have not been very successful. 
As long ago as 192ft E. L. Thorndike suggested that, 
in addition to abstract and concrete intelligence, ob- 
servations of everyday life suggested a third kind of 
ability, which he called social intelligence. In accor- 
dance with Thorndike's suggestion, Moss and his co- 
workers (1927) produced the George Washington Social 
Intelligence Test. 

R. L Thorndike (1936) factor analysed the five sub- 
tests of this instrument along with the five subteats of 
^ George Washington Mental Alertness Test (a general- 
intelligence measure) and found no social-intelligence 
factors. 

Woodrow's (1939) factor analysis of 52 variables 
including the five Social-Intelligence Test subtests, as 
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well as tests of attention, musical ability, spatial ability, 
and general intelligence, corroborated ” L, Thorndike's 
findings. None of the ten factors extracted by Woodrow 
was represented uniquely by the social-intelligence sub- 
tests. These subtests were found to be loaded on fac- 
tors defined by verbal or memory variables. Considering 
that almost all the items of the Moss Social-Intelligence 
subtests are verbally presented, and that the keyed 
answers are correct in the "Emily Post" sense, the 
high loadings of these subtests on verbal factors are 
not surprising. 

A more promising approach to the measurement of 
individual differences in social intelligence was sug- 
gested in a 1933 dissertation (Wedeck, 1947) carried out 
under Spearman's direction. Wedeck's leanings toward 
"g" notwithstanding, the intent of his research was very 
similar to that of the present study, to demonstrate the 
existence of a "psychological ability" (social intelli- 
gence) different from g and verbal ability. To this end, 
Wedeck constructed eight psychological-ability tests 
which used either auditory or pictorial stimuli. The 
pictorial stimuli included drawings and photographs of 
both facial expressions and social situations. A tetrad- 
differences analysis of these social-intelligence tests, 
along with seven tests of verbal and spatial abilities, 
resulted in three non-orthogonal clusters. Wedeck 
named these factors, g, for general intelligence, v, for 
verbal ability, »ndV, for psychological ability. 

For the purposes of the present study, Wedeck's 
correlation matrix was reanalyzed using the principal- 
factor method. This factor -analytic solution, when 
rotated to the varimax criterion, yielded five interpret- 
able factors. The first of these factors was a verbal 
cluster, the second, a figural (spatial) grouping, and 
the remaining three factors were defined by the 
psychological-ability tests. Wedeck's success in dem- 
onstrating social- intelligence factors with tests using 
visual stimuli should be noted. This is the kind of stim- 
uli most often relied upon in constructing tests for the 
present study. 

HYPOTHESES 

The main hypothesis of this study is that social in- 
telligence comprises a group of intellectual abilities each 
of which is demonstrably independent of pqgyiously 
identified intellectual factors. 

An important feature of this hypothesis is the defini* 
tion of social intelligence as encompassing many differ- 
ent intellectual abilities. Factor-analytic research has 
indicated that Thorndike's "abstract intelligence" is 
too broad and vague an entity to be descriptive of the 
way man thinks. Since the thirties, a variety of verbal 
and symbolic factors, roughly comparable to Thorndike's 
"abstract intelligence, " have been identified and sub- 
stantiated. It was expected, then, that Thorndike's 
"social intelligence" would involve, not one ability, but 
many different ways of being socially intellif nt. 

In hypothesising what these ways of being socially 
intelligent are, a systematic theory of human intellect, 
Guilford's SI (structure -of-intellect) model, was used. 
The SI model was the only theory offering any hypotheses 
about the organisation of social intelligence viewed as 
intellectual ability. 

The Structure of Intellect 

The ideas basic to the SI theory were promulgated 
by Guilford in 1955, and were refined in publications 



in 1956, 1957, 1958, and 1959. The version of the model 
used in the present study is that presented by Guilford 
and Merrifield in I960. 

The SI model is a three-way classification of intel- 
lectual factors designed to encompass known aptitude 
factors and to predict the existence of undiscovered 
ones. The model serves a function similar to that of 
Mendeleeff's table of chemical elements. 

The three dimensions of the SI model specify (1) the 
content, (2) the operation, and (3) the product of a given 
intellectual act. The theory hypothesizes four kinds 
of intellectual content— semantic, symbolic, figural, 
and behavioral. Semantic content is most often en- 
countered in standard aptitude tests that demand recog- 
nition of word meanings. Symbolic content refers to 
information such as numbers and letters, which have 
no significance in themselves. Musical and mathemat- 
ical notations are two examples of this content area. 
Information that is concrete or perceivable as space 
or contour is said to inhabit the figural- content area. 
A synonym for figural is spatial. 

The fourth content area is that with which the present 

study is most directly concerned the behavioral one. 

The domain of behavioral intelligence was added to the 
SI model solely as a theoretical extrapolation. The 
kinds of information subsumed under this content area 
include feelings, motives, thoughts, intentions, atti- 
tudes, or other psychological dispositions which might 
affect an individual' s social behavior. 

The operation dimension of the SI model includes 
intellectual processes or activities— what the organism 
does to any particular kind of content. Five different 
intellectual operations are hypothesized: cognition, 
memory, divergent production (generation of variety 
of output), convergent production (generation of the one 
correct solution), and evaluation (judging in terms of 
criteria). 

The product dimension includes the results of intel- 
lectual processing. The six product categories are as 
follows: units (elements having "thing" character), 
classes (aggregates, the members of which have com- 
mon properties), relations (connections between units), 
systems (organized or structured information), trans- 
formations (changes or redefinitions in known informa- 
tion), and implications (extrapolations in the form of 
predictions or antecedents). 

Each intellectual factor may be uniquely described 
in terms vf one of four content areas, one of five oper- 
ations, and one of six products (see Figure 1). The 
structure of intellect predicts the existence of 120 sep- 
arate intellectual abilities. Spearman would most cer- 
tainly have disagreed with such a large number of sep- 
arate aptitudes. However, apart from behavioral 
abilities, 64 intellectual factors have been isolated, 
many of them suggested by the structure -of-intellect 
theory before they were empirically demonstrated. 

In view of the earlier failures to establish the fac- 
torial existence of a social intelligence, any success 
the present study may have in demonstrating behavioral- 
intelligence factors would also indicate the usefulness 
of the SI model. 

Definition of Social Intelligence 

Within the behavioral-content area, the SI model 
predicts the existence of 30 different social— or be- 
havioral*— intelligence factors (six products for each 
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Model of the Structure of Intellect 



of the five operation*). These factors are suggested 
by analogy to factors already known to exist in the other 
content areas. 

The demonstration of 30 new factors at one time is 
not presently feasible. For this reason, the first phase 
of this investigation of social intelligence concentrated 
on the six factors of behavioral cognition: (1) cognition 
of behavioral units', (2) classes, (3) relations, (4) sys- 
tems, (5) transformations, and (6) implications. An 
investigation of these cognitive or comprehension abili- 
ties is held to be fundamental, basic to the later explo- 
ration of other kinds of behavioral intelligence. 

As indicated at the beginning of this report, beha- 
vioral cognition or behavioral understanding, the "ability 
to judge people, " is what many psychologists mean by 
the term "social intelligence. " In the present study, 
behavioral cognition is defined as the ability to under- 
stand the thoughts, feelings, and intentions (psycholog- 
ical dispositions) of other people. 

This comprehension of other people does not include 
comprehension of the generalized-other (the average 
college sophomore, the middle -class* American house- 
wife). Some empathy tests are concerned chiefly with 
such stereotypic understanding (Kerr, 1957), but Bron- 
fenbremer and his colleagues (Bronfenbrenner, Harding, 
It Gellwey, 1958) have clearly distinguished this kind 
of social sensitivity from that involved in knowing the 
feelings of a given individual. The present study is 
limited to an investigation of the understanding of indi- 
vidual others, not average others. 

In addition, for the purposes of this stufly, behav- 
ioral cognition is not considered to include the under- 
standing of one's own motivations and feelings. Such 
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comprehension may involve other aptitudes or traits, 
such as the ability to be objective about one's self as 
readily as about another person. 

Beyond Behavioral Cognition 

Although the first phase of the present study deals 
only with behavioral cognition, the importance of the 
other behavioral operations should not be overlooked. 
A person might understand a social situation (behav- 
ioral cognition) and be incapable of doing anything about 
it. To know is not to do. Yet the person who can do, 
in a social situation, possesses an aptitude indispensable 
for social functioning. 

Two intellectual operations of the structure of intel- 
lect are particularly concerned with this "doing" aspect 
of social intelligence. Doing just the right thing at the 
right time is the kind of ability subsumed under behav- 
ioral convergent production. Social creativity, or being 
able to get out of, or into, a social situation through the 
production of many or unusual behavioral maneuvers, 
is considered behavioral divergent production. A follow- 
up phase of this study is concerned with the development 
of means for identifying the socially creative, using as 
guidelines the results of the behavioral-cognition analysis. 

To round out the picture, the two remaining behav- 
ioral operations should be mentioned. Behavioral 
memory is crucial for politicians, administrators, and 
psychotherapists, who must remember the social char- 
acteristics of their constituents, cohorts, and clients. 
The ability to make judgments about another's behavior 
(behavioral evaluation) is particularly necessary for 
jurists, clergymen, educators, and all those who are 
concerned with the appropriateness of behavior. 
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Restatement of the Hypotheses 

Having indicated the vastness of the terrain, the 
necessity yf first establishing a few landmarks is clear. 
Therefore, the first phase of the present study was con- 
fined to an exploration of the six hypothesized factors 
of behavioral cognition already described. The main 
hypothesis of this study is that there are six separate, 
intellectual abilities involved in understanding other 
people, and that each of these is factorially distinct 
from previously isolated intellectual abilities. 

ASSUMPTIONS 

Intellectual activity is based very much on sensory 
input. There is no reason why behavioral intelligence 
should be an exception. Feelings and motives, the 
"stuff" of behavioral cognition, ate not tangible to the 
outside observer. Therefore, sensory representatives, 
carriers of these intentional states, are needed. 

In this study, it is assumed that expressive behavior, 
more particularly facial expressions, vocal inflections, 
postures, and gestures, are the cues from which inten- 
tional states are inferred. Comprehension of the mani- 
fest cue is taken to be equivalent to knowledge of the 
emotional state underlying it. Thus, behavioral cog- 
nition is more fully defined as the ability to understand 
the thoughts, feelings, and intentions of other people 
as manifested in discernible, expressional cues. 

Ideally, in measuring social intelliger.ee, "...a 
genuine situation with real persons. . . " (Thorndike, 
1920) would be used. Practically, such a real-life 
situation is prohibitively uneconomical. The factor - 
analytic paradigm demands a large sample of examinees 
and several tests for each factor under investigation. 
For the purposes of the present study, the situational 
requirements would mean that each of at least 200 sub- 
jects be given each of at least 18 situational spcial- 
intelligence tests. 

For the sake of ecQmmy, then, it was necessary to 
devise tests which used less than life-size stimuli. In 
the present study, the stimuli used were photographs, 
drawings, cartoons, and tape-recorded words and sounds. 
At first, it was hoped that motion-picture tests of be- 
havioral intelligence could be constructed, motion pic- 
tures being closer to real life than static stimuli. The 
activity dimension added to expressional behavior by 
motion pictures was also an important consideration. 
The rapidity and smoothness with which an expression 
is executed may add greatly to its communicative value. 
However, cost prohibited motion-picture tests of be- 
havioral cognition. Furthermore it was believed that 
the more complex stimuli provided by normal motion- 
picture scenes would lead to factorially complex tests, 
where univocal tests were wanted. 

Taft (1955) has criticised the use of photographs and 
drawings of expressions in social-intelligence research. 
He believes that the emotions so portrayed are stereo- 
typic rather than idiosyncratic, and that the investigator 
of social intelligence is more properly concerned with 
the latter. It is doubtful whether the breach between 
the communicative -idiosyncratic expression, and its 
stereotypic counterpart, is as great as Taft suggests. 
Certainly, the one is the basis for the other. An under- 
standing of the usual way of expressing a feeling would 
seem requisite for more refined comprehension, ha the 
present study, it is assumed that understanding of stere- 
otypic expression is tantamount to comprehension of 
veridical-idiosyncratic expression. 



Despite the many criticisms raised against it, the 
use of two-dimensional stimuli, such as photographs 
and drawings, in judging the communication of emotion, 
has a long history (Ruckmick, 1921). Recently, even 
stimuli such as stick figures and silhouettes have been 
used to assess social-cognitive processes. 

If one is willing to assume that an emotionally dis- 
turbed person is at least temporarily deficient in social 
intelligence, some indirect evidence supporting the 
validity of two-dimensional stimuli in assessing this 
ability may be cited. Sarbin and Hardyck (1955) have 
reported that schizophrenics are inferior to normal 
persons ir attributing a modal-behavioral intention to 
drawings of stick figures. Using silhouette profiles, 
Knapp (1963) found that mental -hospital patients were 
inferior to unhospitalized individuals in detecting inter- 
actional behavior in silhouette diads. 

Stimuli such as stick figures and silhouettes seem 
even further removed from real life than photographs 
and drawings of expressional behavior. If stick figures 
and silhouettes discriminate between two groups as- 
sumed to be different in mean social intelligence, equal 
utility may be expected from photographs and drawings. 

Tests using words have failed to define factors of 
social intelligence in the past. Because of this, the 
present study has relied almost entirely on photographs, 
drawings, and auditory stimuli. Wedeck's success in 
isolating social-intelligence factors with tests using 
such stimuli has been noted. 

This neglect of verbal stimuli does not mean that 
verbal information cannot be behavioral in nature. Ver- 
bal is not synonymous with semantic. Just as semantic, 
non-behavioral information can be conveyed pictorially, 
behavioral information can be expressed verbally. How- 
ever, bearing in mind the earlier factor -analytic results, 
only a few behavioral tests use verbal-behavioral stimuli. 

THE TEST BATTERY 
Construction of the Experimental Tests 

The behavioral tests constructed for this study em- 
ployed photographed, drawn, and other less than real- 
life depictions of intentional or emotional states. The 8? 
kinds of stimuli have been used before in studies of 
judging emotion (Boring & Titchener, 1923; Buzby, 
1924; Landis, 1924; Dunlap, 1927). However, factor- 
analytic test construction in which such stimuli are used 
presents special problems. Adequate assessment of 
th® reliability of a test and the discriminating power of 
its items requires that the test be pretested using rela- 
tively large groups of examinees. Group pretestings 
of photographed items necessitate printed tests, which 
are expensive. 

To circumvent unnecessary expense, for most of the 
behavioral tests a pool of about 40 items per test was 
prepared. These "tests" were then administered indi- 
vidually to about 30 examinees. On the basis of these 
informal pretestings, testing time was ascertained, and 
the 30 best items selected for the printed form of the 
test. If 30 good items (good in terms of consensual 
validation of the key and discrimination between high- 
and low-scorers on the total te* t) were not found, ad- 
ditional items were written or the number of items in 
the printed form of the test reduced. 2 

*Mr. Lynn Rehm and Mr. Barry Karp deserve credit 
for contributions to the construction of several of the 
behavioral tests. 
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The printed test was then group pretested. Such pre- 
testings indicated that some of the items in the printed 
tests were not good discriminators. If the reliability 
was acceptable, however, the test was retained in its 
initially printed form for administration in the final 
test battery. 

In constructing the behavioral tests, three approaches 
were used. The strategy used most often was to con- 
struct a behavioral-cognition test by analogy to an exist- 
ing SI test in another content area. For example, a test 
commailyused aw a measure of the verbal-comprehension 
factor (cognition of semantic units, or CMU in SI ter- 
minology) presents the examinee (E) with a word. E is 
to indicate understanding of the meaning of the given 
word by choosing, from among several alternatives, 
the one word that means about the same thing. It is ex- 
pedient in devising a test of CBU (cognition of behavioral 
units) to use the same test format, merely replacing 
' the stimuli with new ones appropriate to the behavioral- 
content area. 



Experimental Factors and Tests 
CBU Cognition of behavioral units. 

As already stated, the unit or element of behavioral 
content was represented by an expression, whether a 
facial expression, a vocal inflection, a gesture of the 
hand, or a posture of the entire body. A variety of such 
expressions was drawn, 3 suggested in part by Krout's 
(1935) list of autistic gestures. The facial expressions 
in this group of drawings used as models the Marjorie 
Lightfoot series of photographed facial expressions i 

(Engen, Levy, & Schlosberg, 1957; 1958) and photo- 
graphs of the actor Fernandel (Ha Is man, 1949). This 
first group of drawings was reproduced, and several < 

of the individual drawings, particularly those of postures 
and hand gestures, were used more than once. A second 
group of drawings, mostly of facial expressions, was 
produced, using as models expressions found in books 
of movie stills, newspaper and magazine photographs, 
and the expressive behavior of Project personnel. Draw- 
ings in this second pool were seldom used twice. 



Representing the unit in the behavioral domain by an 
expression, the test constructor may then present E 
with a photographed or drawn facial expression. E's 
task is to indicate comprehension of the behavioral 
meaning of the expression by choosing an alternative 
expression that conveys the same feeling. 

In an area so full of uncertainties as that of social 
intelligence, this test-construction strategy is especially 
needed. It can suggest test ideas that inspection of the 
raw material of the social situation would never call 
to mind. There are disadvantages, however. By 
adhering too closely to a test-construction paradigm that 
only parallels tests defining other factors, one may un- 
necessarily confine, and even distort the factors which 
emerge, and so obscure rather than illuminate the rele- 
vant abilities. 

The second method of test, construction used in this 
study is also firmly rooted in the SI theory. The posi- 
tion of a hypothesized factor in the model automatically 
carries with it a description of the factor. From this 
description, test ideas often result. Cognition of be- 
havioral relations (CBR) means the ability to understand 
social relationships. A very common, observable social 
relationship is the diadic or two-person one. A test 
hypothesized to measure the factor CBR might present 
a variety of diads. The comprehension of these pair- 
relations may then be assessed in the usual multiple- 
choice test format. 

The paper -and -pencil nature of the behavioral tests 
constructed for this study dictated the predominant use 
of test construction by analogy or definition. However, 
an effort was made to conceptualize behavior that was 
socially intelligent in a context other than that of the 
structure of intellect, and then to fit such behavior into 
a test format consonant with the model. Examples of 
this third test-construction approach include an attempt 
to define a particular kind of humor as a behavioral 
ability ( Who Said it ? ). and the construction of a test 
based on a psychotherapeutic technique, "reflection of 
feeling," (Reflections ). 

In the discussion of behavioral and marker factors 
which follows , the individual tests will be described 
only briefly. Farther information, as well as sample 
items, may be found in Appendix A. 



Of all the behavioral-product factors, the task of 
devising tests hypothesized to measure CBU was per- 
haps the easiest. For three of the four CBU tests, 
Expressions . Faces , and Inflections , test construction 
by analogy dictated the easily followed vocabulary-test 
format. A fourth CBU format, as exemplified in Ques- 
tions 11 . was discovered serendipitously. 

Expressions — —Indicate comprehension of a drawn 
expression by choosing the one of four alternative draw- 
ings that expresses the same feeling. Of concern in 
investigations of SI factors is the equivalence of units 
within a content area. In studying symbolic evaluation 
(Hbepfner, et al. , 1964), for example, it was necessary 
to determine whether both letters and numbers might 
be considered symbolic units. In the present study, the 
equivalence of facial expressions, vocal inflections, 
gestures, and postures as cues for behavioral units was 
assumed. 

Ideally, only one expressional mode would be used 
in each behavioral-units test. If these single-mode 
tests, each using a different expressional mode, were 
loaded on the same factor, the unit -equivalence of ex- 
pressional modes might be reasonably inferred. Un- 
fortunately, the more than 100 different hand gestures 
or body postures required for each test (30 items per 
test, with four stimuli per item) are not easily produced. 

As an alternative, Expressions was constructed to 
include all manner of static-visual expressions. Given, 
for example, a drawing of a clenched fist, the correct 
answer might be an angry face. Care was taken to in- 
clude distractors similar in mode and general appear- 
ance to that of the given; a distractor for hands-on-hips 
in anger might be hands -on- hips, relaxing. 

Pretesting results indicated that the Es found hand 
gestures the most difficult to interpret. This difficulty 
may reflect an experiential bias; few Americans are 
as flamboyantly expressive as Mediterraneans, whose 
gestures are routinely used to caricature them. 

Faces — Choose the one of four photographed men's 
faces that expresses the same feeling as that of a wom- 
an's face. Facial expressions are probably the most < 



The stimuli used in this study were drawn by 
Mr. Peter Plagens, Mr. Walter Gabrielson, and 
Mr. Cheh Nam Low. 






Table 1 



Distribution of Stimuli among 23 Behavioral Cognition Tests a 



Products 


Cartoons 


Drawings 


Photographs 


Sounds 


Words 


Others 


Units 




Expressions 

(Inflections) 


Faces 

Questions II 


Inflections 


(Questions U) 




Classes 


Odd Strip Out 


Expression 

Grouping 


Picture 

Exclusion 


Sound 

Meaning 


(Sound 

Meaning) 




Relations 


Social 

Relations 


Cartoon 

Analogies 


(Silhouette 

Relations) 




(Social 

Relations) 


Silhouette 

Relations 

Stick Figure 
Opposites 


Systems 


Missing 

Cartoons 




Missing 

Pictures 

Facial 

Situations 




(Facial 

Situations) 




Transformations 


Cartoon 

Exchange 


Expression 

Exchange 


Picture 

Exchange 

Who Said ft ? 




Social 

Translations 
(Who Said ft?) 




Implications 


Cartoon 

Implications 

Cartoon 

Predictions 






Reflections 


(Reflections) 

(Cartoon 

Implications) 





* Parenthesized test names indicate stimuli combinations. Column in which parentheses occur is that of 
the less important stimulus. 



obvious and often-used expressional cues. Thus, the 
measurement of the ability to comprehend facial ex- 
pression would seem requisite for understanding the 
larger cognition of another's intentions. Faces was 
constructed to fill this need. 

Photographs were used in this CBU test to satisfy 
the demands of good experimental design, ft seemed 
desirable to counterbalance as much as possible the 
hinds of stimuli used in tests of the same factor so as 
to prevent an artifactual photograph or drawing factor 
from occurring. For this reason, in construct ing tests 
for each of the behavioral-cognition factors .tests were 
designed to span stimuli types. Table 1 describes the 
distribution of kinds of stimuli among the 23 behavioral 
tests, over the six product factors. Faces follows this 
paradigm, being a photographic analog of Expressions. 

The Marjorie lightfoot and Frois-Wittman (Hulin & 
Kata, 1935) series of photographs were used in Faces , 
because the grant under which this study was initiated 
was not budgeted with sufficient funds to produce new 
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photographic material. At first, an attempt was made 
to key the items of Faces according to the scale values 
published for both series of pictures (Schlosberg, 1952; 
Levy U Schlosberg, I960). Such pairings, however, 
were so obvious as to be useless in a test from which it 
was hoped normally distributed scores could be derived. 

Inflections — Choose the one of four drawn facial 
expressions that expresses the same feeling as a tape- 
recorded vocal inflection. To determine whether vocal 
inflections might be cues for behavioral units, the test 
called Inflections was constructed. First, six socially 
neutral phrases (yes; mother; I did it; well; really; 
and that's good) were selected. Each of these phrase 



The following tests were constructed under Grant 
G- 18074 from the National Science Foundation: Expres- 
sion*. Faces , Matching Expressions , Face Grouping . 
Social Relations . Missing Cartoons. Facial Situations. 
Cartoon Exchange . Social Tranalationa . Cartoon Impli- 
cations . Questions. and Writing Inner Thoughts . 











has quite different social meanings if said with different 
inflections. 

Three actors produced a variety of inflections for 
each of the six phrases. Some of the inflections were 
suggested by the test constructor; others were spon- 
taneously produced by the actors. From this pool of 
tape-recorded inflections, five different inflections were 
chosen for each of the six "neutral" phrases. The final 

test is composed, then, of 30 inflections six different 

phrases, each said with five different inflections. 

For each item of the test, the same inflection was 
mechanically reproduced on tape four times to permit 
E to match the inflection with each of the four alterna- 
tive facial expressions in turn. The items of Inflections 
are alternated according to sex, half of the inflections 
and corresponding facial expressions being male and 
half female. 



Questions II— —Choose the one of four alternative 
questions that might have provoked a given photographed 
facial expression. Halsman's The Frenchman (1949) 



suggested a test, known as Questions , which was origi- 
nally intended as a measure of cognition of behavioral 
implications. Each item of this test presented a picture 
of the face of Fernandel, with four accompanying ques- 
tions. One of these questions might have been the stim- 
ulus for the particular expression shown. It was thought, 
at first, that the correct question would be selected as 
an implication from Fernandel' s expression (an extrap- 
olation to an antecedent). However; correlations indi- 
cated that success at the task depended on the cognition 
of the facial expression, the question alternatives serv- 
ing as a rather direct means of assessing this compre- 
hension. Therefore, following extensive item analy- 
ses, Questions was rewritten as a units test and called 
Questions II. 



each of which belongs with one of the groups given. This 
format was unsatisfactory, however, because the items 
were not independent. If E chose alternative A to class 
with group 1 and alternative A really belonged with group 
2 , he would fail both items. 

The items in Expression Grouping used essentially 
the same groups as were used in Matching Expressions , 
but the alternatives to be classed with them are pre- 
sented separately for each item. Most of the item- 
groups in this test are semantically specifiable ("scold- 
ing," "admiration"), but a few "fee ling -tone" groups 
were included as well. 

Picture Exclusion Choose the one of four photo- 

graphed expressions that does not belong with the other 
three. Picture Exclusion , an exclusion -type test, uses 
photographs of hand gestures, facial expressions, and 
body postures (with the faces blocked out) which were 
produced especially for it. The actors were, for the 
most part, college drama and physical-education majors. 

Although an attempt was made to have four different 
expressional modes for each item, not enough head- 
shoulder inclinations were available for this purpose. 
Most items, therefore, contain two pictures of faces 
(of different actors), one of a body, and one of hands. 
.Almost all the items in Picture Exclusion are of the 
difficult-to- verbalize, "fee ling -tone" type. 

Results from pretesting indicated that most Es an- 
swered the items in Picture Exclusion on the basis of 
the facial expressions alone. To control for this ten- 
dency to respond only on the basis of facial expression, 
the instructions for Picture Exclusion emphasize the 
necessity of using all four pictures in answering each 
item. 



CBC - Cognition of behavioral classes. 

By definition, ,a class is an aggregate, a set whose 
members possess a common attribute. It is all too easy 
in constructing tests of behavioral classes to group ex- 
pressions into sets that make semantic sense but may not 
reflect behavioral aggregates. For example, "nervous- 
ness is a class under which many behaviors may be sub- 
sumed. The question, however, is whether "nervousness" 
is a label for a genuine behavioral set, or just a semantic 
expediency. Behavioral classes may well be semantically 
ill-defined feeling groups, such as inward, against, neg- 
ative, or active. So as not to prejudice the behavioral- 
classes tests in the favor of those who are capable of 
verbal niceties, groups formed on the basis of gross- 
feo ling states were used at least as often as those sug- 
gested by verbal labels. In addition, in the four classes 
tests used in the final battery of this study, tlnee formats 
are represented: grouping, exclusion, and naming. 

Expression Grouping — -—Choose the one of four drawn 
expressions that goes with a given group of three ex- 
pressions. Expression Grouping is a test having a 
grouping format (Which of these alternatives goes with 
this group?) and using the same stimuli as were used 
in the units test, Expressions . This classes test is 
based on an earlier CBC test, Matching Expressions . 

In Matching Expressions , sets of three groups of 
three expressions each were presented to E. His task 
was to choose, from five alternatives, three expressions 



Although Picture Seclusion is the only photographic - 
classes test used in this analysis, another CBC test 
using the Lightfoot and Frois-Wittman pictures had been 
developed and was called Face Grouping . Each item of 
this classes test presents E with a group of three facial 
expressions. The task is to group one of two alternative 
facial expressions with the given set. 

The reliability of Face Grouping was exceedingly low. 
The small number of alternatives. and the negative reac- 
tions occasioned by the Frois-Wittman pictures may well 
have sponsored random test -taking behavior. No further 
use was made of this test. 

Odd Strip Out — —Choose the one of three cartoon 
strips in which the cartoon character, Ferd'nand, re- 
sponds differently than he does in the other two. Most 
usually, the members of classes are thought of as units, 
as in Expression Grouping and Picture Exclusion. This 
need not always be the case. 

In Odd Strip Out , the class members are behavioral 
systems, organized sequences of social behavior. Spe- 
cifically, the systems in this test are the personality 
traits of the main cartoon character, Ferd'nand. The 
sample item for Odd Strip Out given in Appendix A shows 
Ferd'nand being oblivious to the feelings of others. This 
characterization is inferred not from one cue or expres- 
sion but from the continuity of Ferd'nand' s reactions in 
a complex social situation. 



We are happy to acknowledge the technical contri- 
butions of Mr. Harold Borden and Mr. Robert Crutchfield 
to the construction of the auditory-behavioral tests. 



Parenthetically, the Ferd'nand cartoon* strip (Mik, 
1960; 1961; 1962; 1963; 1964) was used in Odd Strip Out 
as well as in several of the other behavioral tests be- 
cause its cartoon characters interact and react almost 
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entirely in pantomime. Non-verbal communication of 
this type is eminently suited for use An tests of behav- 
ioral intelligence. 

Pretesting results indicated that Odd Strip Out was 
a difficult test for most of the Es. In attempting to 
avoid unduly stereotypic characterisations (the miser, 
the angry boss, the henpecked husband) fairly subtle 
cartoon strips were used. This subtlety may have in- 
creased the systems comprehension necessary for suc- 
cess in this test. 

Somid Meaning — —Choose the one of four words that 
describes a tape-recorded group of three emotive sounds . 
Although intonation or inflection of voice in speech is 
an important communicative device, nonverbal auditory 
cues may also provide behavioral information. A 
icretm, a laugh, a sigh, a whistle each can convey 
different moods and emotions. 

In Sound Meaning , classes were formed from three 
such emotive sounds. (The sounds were made by two 
non-actors, a male and a female. ) These three-sound 
groups were mechanically duplicated on tape. E's task 
was to indicate comprehension of the class property of 
the sound group by choosing the most appropriate of four 
class names. These class names were suggested in 
part by Allport and Odbejrt's (1936) list of trait names. 

One item in Sound Meaning presents the three tape- 
recorded sounds: heavy breathing, a startled laugh, and 
a whimper. The emotive attribute these sounds share 
i* i«ar. To test comp re hens ion of this common proper- 
ty, four alternative words are given: weary, startled, 
depressed, and fearful. Note that each of the first three 
alternatives might be used to describe one of the sounds 
given.. Only the word "fearful" suits all three sounds. 

Verbal labels for the classes were used reluctantly, 
ft has already been suggested that over-dependence on 
semantic labeling was the most serious flaw in earlier 
attempts at measuring social intelligence. The breadth 
of the classes (apparent dissimilarity of the class mem- 
bers) in Sound Meaning ruled out the use of behavioral 
expressions, which are usually quite restrictive and 
specific in meaning. The higher level of abstraction 
offered by words was the only practical sqlution. To 
reduce the semantic variance introduced by the word- 
choice task, the alternative words for each item were 
selected so as to be as different as possible in verbal 
meaning. 

CBR - Cognition of behavioral relations. 

Relationships in the other content areas of the SI 
model refer to meaningful connections between units. 
This definition was taken to hold for behavioral rela- 
tionships as well. In addition, the meaning of the term 
"relationship" in everyday language was used. 

One popular meaning refers to a relationship when 
a social connection exists between two people. In this 
study, it is assumed that it is the interaction between 
the members of a diad that connects and relates them. 
Unless both sides of the diad are "involved, " no rela- 
tionship exists. This view of behavioral relationships, 
emphasizing as it does the diadic interaction, was the 

basis for two of the four CBR tests Social Relations 

and Silhouette Relations . Two-person relationships are 
central to much of the conceptualization in the field of 
social psychology (Foa, 1962). A demonstrable factor 
CBR might prove to be one of the most useful of the be- 
havioral constructs. 



Two other hypotheses about the nature of behavioral 
relationships were employed. In other SI content areas, 
analogies and opposites have been used to measure the 
rolationi abilities. Analogously, the ideas of behavioral 
analogies and behavioral opposition led to the develop- 
ment of the tests Cartoon Analogies and Stick Fiaure 
Opposites . 

Re letions ——Choose the one of three verbal 
statements that fits the expression of a schematic face, 
taking into account the feelings expressed by a second 
face. The research finding (Cline, 1956) that schematic 
feces, when presented in pairs-, were perceived as in- 
teracting, suggested that such face-pairs might well be 
used as stimuli for a behavioral- relations test. Cline's 
three faces (smiling, glum, and frowning -angry) were 
redrawn so that their sex would be more ambiguous, 
and three new faces (wary, surprised, and dejected- 
sorry) were drawn. 

From these six faces, 35 pairs of faces were used 
to construct a completion form of test called Writing 
Inner Thoughts . The task is to write what one of the 
two faces is thinking, taking into account the interaction 
between them. Writing Inner Thoughts was administered 
to 50 college sophomores, many of whose responses sug- 
gested alternatives for the behavioral-cognition test, 
Social Relations . 

All three verbal statements used as alternatives in 
the items of Social Relations are suitable accompani- 
ments for the expression of the "target" face. Only one 
alternative, however, is appropriate if the expression 
of the second face is also considered. In this way, an 
item can be answered correctly only if the interaction 
between the members of the pair is understood. 

Silhouette R elations — Choose the one of three photo- 
graphed faces that expresses the same feeling as that 
of one member of a diad shown in silhouette (head-and- 
shoulders) profile. Knapp (1963) had found that different 
intentions and feelings were attributed to diadic silhou- 
ettes depending on the tilt and elevation of each member 
of the diad with respect to one another. Taking a sil- 
houette profile by itself, its angle relative to its ground 
is practically meaningless. It connotes little but that 
the silhouette isn't straight on the page. In combina- 
tion with another profile, which may be seen as inter- 

acting with it, such a positional cue may have social 
meaning. 

Although Knapp has used a variety of silhouette pro- 
Silhouette Relations uses only his young-woman- 
facing -young -man diad. Each item of this test presents 
the same young man and woman. But since their rela- 
tive positions are never the same, each item- relationship 
is different as well. 

Comprehension of the silhouette relationships was 
assessed by means of photographed facial expressions 
as multiple -choice alternatives. Some of these photo- 
graphed faces were produced especially for this test; 
most were adapted from the stimuli used in other pho- 
tographic tests of behavioral cognition. 

Instead of alternating items according to sex, in Part 
I of Silhouette Relations, the alternative faces were all 
of men and the task was to choose the face that fitted the 
man's feelings in the relationship. In Part H of the test, 
photographs of women were used as alternatives. 

The silhouette relationships in this test are very 
difficult to verbalize; Es have consistently expressed 
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great uncertainty about their teat answers. However, 
of 240 total teat scores, none was so low that it was 
readily attributable to chance success. 

Cartoon Analogies — -Choose the one of three alter- 
native expressions that ia related to a third given ex- 
pression in the same way that a second given expression 
is to the first. Among verbal teats, those having an 
analogies format are among the best known. Verbal- 
analogies testa have defined semantic -relations factors 
in the past (Guilford, et al. , 1951). It seems reasonable 
to expect an analogies test using behavioral stimuli to 
measure a behavioral- relations ability. 

An analogy format presents certain difficulties to the 
behavioral-test constructor, however. The analogy 
relation is usually a sophisticated one. The ability to 
handle such abstraction* might easily involve highly 
developed semantic skills that would overshadow the 
behavioral components of the task. In addition, most 
verbal analogies are of the part -whole type or the causal 
type. In the behavioral realm, a part-whole relation- 
ship can all too readily be seen as a similarity relation, 
a categorization more appropriate to a units or classes 
test. Causality relationships are difficult to establish 
with only one expression or cue. Situational or idio- 
syncratic information must be supplied as well. There- 
fore, few causality relationships were used in the behav- 
ioral-analogies test. Instead, the items in Cartoon 
Analogies depend mostly on situational or interpersonal 
relations. For example, in the Cartoon Analogies item 
given in Appendix A, the given relation might be verbal- 
ised as, threatening : protective, an oppositional rela- 
tionship, but one which also might define an interactive - 
social situation. 

Stick Figure Opposites Choose the one of three 

stick figures that expresses a feeling opposite to that of 
a given stick figure. Sarbin and Hardyck's (1955) re- 
search with stick-figure material suggested that such 
stimuli would be useful in assessing social- cognitive 
processes. In the present study similar stick figures 
were used to ascertain whether opposition of expression 
could be considered a relation. It was thought that such 
might be the case if the difficulty of the task lay in de- 
termining the dimension of intention along which the 
opposition lay. Seeing a variable is seeing a relation. 
This conjecture received some support from the fact 
that a semantic test of opposites, Inventive Opposites , 
has been loaded on a semantic-relations factor (Guilford 
It Christensen, 1956). 

The construction of Stick Figure Opposites was based 
on the hypothesis that opposition of units is a relation. 
The intentional oppositions used in the items of this test 
are mostly of the "fee ling -tone" type (active -passive, 
open-closed) used in some of the behavioral-classes 
tests. 

CBS - Cognition of behavioral systems. 

The systems product has usually been defined as 
organized, complex, interrelated information. In this 
study, behavioral systems were conceptualized most 
often as sequences of social behavior, or stories in 
which the feelings and intentions of individuals are of 
paramount importance. It might be mentioned that 
terms such as sequence and story were chosen because 
they connote temporal -order, events occurring in time. 
Two of the three behavioral- systems tests used in this 
analysis. Missing Cartoons and Missing Pictures , were 
designed to measure this ability to understand unified 
sequences of intentional behavior. 
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On the other hand, the element of time need not be 
a crucial one. A behavioral system might be thought 
of as a social situation, an episode in which only the 
interrelatedness of the characters is pertinent. In a 
situational- system test, the systems variance is con- 
tributed not by an increased number of events as would 
usually occur given the passage of time, but by the com- 
plexity of the interrelations of the characters with one 
another and with their environment. Facial Situations 
was based on this situational definition of behavioral 
systems. It was designed, also, to clarify the distinc- 
tion between the behavioral products of relations and 
systems-— relatedness and interrelatedness. 

One of the tests hypothesized to measure the CBC 
factor, Odd Strip Out , employed classes of systems 
rather than classes of units. The systems used in Odd 
Strip Out were sequences of behavior. Over and above 
this, the systems were classified on the basis of the 
behavioral consistency or similarity of personality traits 
manifested by the main cartoon character. 

Thus, the perceived personality of an individual is a 
possible candidate for the SI behavioral- systems cate- 
gory. The interrelatedness necessary for a system can 
be seen in the exhibition of the same behavior in a vari- 
ety of situations; the organization essential to a system, 
in the relatively constant amounts of personality traits 
possessed. Such a definition of behavioral systems is 
an exciting one, for it suggests a new, more rpecific, 
and more operational definition of personality. Unfor- 
tunately, the difficulties in constructing tests of this sort 
precluded their use in the present analysis. 

Missing Cartoons — Choose the one of four alternative 
cartoons that completes a cartoon strip. In constructing 
Missing Cartoons . Ferd'nand cartoon strips were chosen 
that were intentionally, rather than semantically, com- 
pelling; that is, the "point" of the strip is primarily 
dependent on the feelings of the characters involved. 
Each item consists of a cartoon strip in which one of the 
four panels has been removed. Understanding of the 
behavioral system is tested by having E choose the one 
of four alternative cartoons that will correctly complete 
a given cartoon strip. For each item, all of the alter- 
natives make semantic sense (see Appendix A), but only 
one alternative is possible if the feelings of the cartoon 
characters are taken into account. 

To prevent differences in drawing style from being 
used as a cue in deciding which cartoon correctly com- 
pletes the strip, the four alternative cartoons for each 
item were drawn by the same artist. As a further pre- 
caution against the presence of semantic cues in the 
cartoons, punctuation marks such as question marks 
and exclamation signs were removed. 

Missing Pictures — Choose the one of three photo- 
graphed situations that completes a given pictorial story. 
The hypothesis underlying Missing Pictures is identical 
to that on which Missing Cartoons is based. Although 
the formats of the tests are similar, the stimuli used 
are different. Missing Pictures is a photographic ana- 
log of Missing Cartoons. «■ 

The photographs used in Missing Pictures were pro- 
duced specifically for this test. The photographs depict 
story situations which were invented before the pictures 
were taken. For the most part, the actors involved in 
the photographs were college students without dramatic 
experience. Most of the items in this test are based on 
young-adult and school situations. This bias was useful 
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with Es in the present study, high-school students, but 
it may limit the acceptability of this measure inother 
testing situations. 

Facial Situations — —Choose the one of three verbal 
descriptions of a situation that fits the expressions on 
both of two photographed faces. Unlike the other two 
behavioral- systems tests, the items in Facial Situations 
deal with episodes rather than sequences. Two photo- 
graphed facial expressions, one each from the Lightfoot 
and Frois-Wittman series, are shown. The expressions 
in the photographs are quite different. E is to choose 
the one of three verbally described situations that could 
account for both expressions. 

As may be seen in Appendix A, the format of Facial 
Situations is very similar to that of the behavioral- 
relations test. Social Relations . An important difference 
between the tests, however, is that in Social Relations 
the faces interact, whereas in Facial Situations they do 
not, " " 

One of the purposes of Facial Situations was to ascer- 
tain whether two people in a social situation were suf- 
ficient to constitute a behavioral system. Another goal 
was to determine whether the essence of a relation is 
interaction; a system not being restricted in this way. 
Thus, the hypothesis on which Facial Situations is based 
is that when two people are reacting to a third stimulus 
(another person or an incident), but not to one another, 
their reactions to this third stimulus generates a behav- 
ioral system. Only when the two individuals are reacting 
primarily to one another doss a simple relationship 
exist. 

CBT - Cognition of behavioral transformations. 

A transformation is a change, a redefinition. Several 
of the SI transformations factors coincide roughly with 
abilities that might be considered pertinent to creative 
thinking. A prime example is the factor divergent pro- 
duction of semantic transformations, DMT, also called 
originality or semantic adaptive flexibility. 

A synonym for behavioral transformation might be 
behavioral flexibility. Flexibility in dealing with social 
stimuli would certainly seem crucial in "coping" or 
"adjusting. " That is to say, inability to "ride with the 
punches, " to change sets, might be a large component 
in neuroticism or emotional disturbance. If this is the 
case, the ultimate usefulness of measures of factor CBT, 
the ability to redefine intentional behavior, is an intri- 
guing prospect. 

In some other content areas of the SI model, the iso- 
lation of transformation abilities has been particularly 
difficult (Nihira, et al. , 1964). To favor the emergence 
of factor CBT in this analysis, five tests were construc- 
ted, each hypothesised to measure it. These tests in- 
clude measures of the ability to recognise a transforma- 
tion in a behavioral system (Cartoon Exchange . Picture 
Exchange ), to redefine the dispositional meaning of ges- 
tures and postures ( Depression Be change ), to comprehend 
more than one behavioral meaning in a verbal phrase 
(Social Translation^, and to grasp the humor in captioned 
baby pictures (Who Said It? ). 

Cartoo n Exchange — -—Choose the one of four alterna- 
tive cartoons which when substituted for a designated 
panel of a cartoon strip changes the meaning of the whole 
,tor y* Cartoon Bcchanae is one of the two transformation 
tests in which behavioral systems are redefined. Each 
item presents a complete four -panel cartoon strip. 



These cartoon strips were chosen for the emphasis they 
place on intentional or motivated behavior. Further, 
the meaning or story depicted in the strip could be trans- 
formed by changing one of the four panels in the strip. 
In this way, the meaning of the whole system, could be 
transformed by a change in one part of the system. 

Inspection of a sample item from Cartoon Exchange 
will illustrate this kind of trans formation. In the item 
given in Appendix A, the cartoon strip in the top row 
shows Ferd'nand noticing a pretty girl and using his 
hoop as a means of getting to know her. E' s task is to 
change the story by substituting one of the cartoons in 
the second row for the cartoon indicated by the arrow. 
Alternative cartoons 1, 3, and 4 could be substituted for 
the arrowed cartoon with no change in Ferd'nand' s moti- 
vation. Alternative 2, however, would effect such a 
transformation. Ferd'nand noticed a friend of his on 
the sand, so he went down to talk to her. The point of 
the story is different; it has been redefined. 

Cartoon Exchange is like the systems test Missing 
Cartoons in at least two respects. Both tests use the 
same kind of stimuli, Ferd'nand cartoon strips, and 
even more important, both tests employ behavioral 
systems. In Missing Cartoons , the systems variance is 
essential; in Cartoon Exchange , it is a necessary evil. 
E must comprehend the given system before he can at- 
tempt to cognize its transformation. For these reasons, 
a substantial correlation between the two tests would not 
be surprising. 

Picture Exchange — Choose the one of three alterna- 
tive photographs which, when substituted for one picture 
of a four -picture story, will change its meaning. Just 
** Missing Pictures is a photographed version of Missing 
Cartooni, Picture Exchang e is a pictorial analog of 
Cartoon Exchange . Instead of cartoon strips, series of 
photographs are used to tell stories whose plots are 
based on the intentions and feelings of the actors pic- 
tured. As in Cartoon Exchange , E is to demonstrate 
his ability to cognize a transformation of a behavioral 
system by choosing a substitute for one of the pictures 
in the original story sequence. 

The photographs used in Picture. Exchange were pro- 
duced especially for this test; the actors included college 
students, children, and mature adults. The stories in 
Picture Exchange were less dependent on school settings 
than those of Missing Pictures , and so might be useful 
in a greater variety of testing situations. 

Expr cs sion Exchange — ——Choose the one of three 
sketched facial expressions that changes the meaning of 
a given gesture. The same gesture or posture can often 
be used to convey different behavioral messages. Ex- 
pression Exchange was an attempt to measure the ability 
to cognize transformations in intentional expressions or 
units. 

Each item of this test presents a drawing of a gesture 
or posture accompanied by a particular facial expres- 
sion. This facial expression specifies the behavioral 
meaning of the given gesture. E is to choose an alter- 
native facial expression that not only fits the given ges- 
ture, but also changes or transforms its meaning. For 
example, in the sample item in Appendix A, the gesture 
"hands-on-hips" can be used to express anger, but it 
may also convey provocativeness or "come -hitherness. " 

Social Translations Choose the one of three alter- 

native pairs of people between whom a given verbal 
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statement will have a different intentional meaning, The 
setting in which a social statement is made can affect it 
greatly. Oppose a parent says "I don't think so" to a 
child, In most parent-child relationships, this is an 
unemotional statement of opinion. The child's disagree- 
ment implies little loss of status to the parent, Should 
a student say "I don't think so" to his teacher, however, 
this same statement might signify a challenging, emo- 
tional attitude. Blatant disagreement with one's teacher 
is not a conventional mode of expression, particularly 
if personalised^ don't think so, rather than Mr. Authority 
doesn't agree with you). 

The recognition that different relationships can trans- 
form the meaning of a verbal statement is hypothesised 
to be one kind of behavioral transformation. Social 
Translations was constructed as a measure of this 
ability. 

Who Said It? — —Choose the one of four photographed 
baby's expressions that fits a given caption. Humor is 
an area of psychological. interest about which little is 
known. In this study, it was speculated that some of the 
cognitive components of humor might lie in the behav- 
ioral realm. 

< 

A type of humor that readily suggested itself as ap- 
propriate for the behavioral domain is that used in "baby 
books" (Bannister, 1950; 1952). Pictures of infants 
when paired with captions more appropriate for adults 
are considered funny by almost everyone. The extra- 
ordinary expressions on the babies' faces seemed well 
suited for use in a test of behavioral intelligence. 

Appreciation of this kind of humor was hypothesized 
to be evidence of the CBT ability. It was thought that 
the humor lay in grasping the disparity between the in- 
fant's actual capabilities and the potentialities credited 
to him by the caption accompanying his picture. In 
effect, the caption transforms the infant into an adult, 
and to this incongruity one responds with laughter. 

Not only is the correct baby-picture alternative the 
one that is funny; it is the one that fits the caption best. 
Captions were written especially for this test. E's par- 
ticular brand of sense of humor need not necessarily 
penalize him in responding to the items of Who Said It ? . 
The test is easier if the humor of the items is appre- 
ciated, but other strategies may be used in answering 
them. 

CBI - Cognition of behavioral implications. 

It has been* thought that the SI product category of 
implications is concerned with extrapolations from given 
information to either its antecedents or its consequents. 
Of the three tests written to measure the hypothesized 
CBI factor, one. Cartoon Implications , was based on 
both the antecedents and consequents components of the 
implications definition; a second. Cartoon Predictions , 
only on the consequents part of the definition; and a 
third. Reflections , on the definition of cognition of im- 
plications as a sensitivity-to-problems ability. 

Cartoon Implications— Choose the one of four verbal 
statements that describes what precedes, or will follow 
a cartoon situation. In Cartoon Implications , each item 
presents a single Ferd'nand cartoon. E is to choose the 
one of four verbal statements that describes either what 
led up to the situation shown, or what will happen after- 
wards. Cartoon Implications was designed to measure 
implications, broadly conceived to include both ante- 
cedents and consequents. 



Cartoon Predictions — Choose the one of three alter- 
native cartoons that shows what will follow from a given 
cartoon situation. In dealing with other people, the 
ability to make predictions about their behavior is a 
valuable asset. The importance of this ability may be 
gauged by the research interest it has evoked, Some 

searcher s (Cline It Richards, I960) have narrowed 
their definition of social intelligence so that it includes 
only this ability to make accurate behavioral predictions. 

In Cartoon Predictions , E is to make predictions 
based on the behavioral information included in a car- 
toon. The items in Cartoon Predictions employ an orig- 
inal cartoon character, named Barney. The predictions 
made are stereotypic in that the correct response is the 
one that would usually happen next. Attempts were 
made to delineate idiosyncratic personalities about which 
predictions were to be made— a situation more like that 
in real life. However, much information is needed be- 
fore any but obvious predictions can be made about an 
individual. &tch personality descriptions were rejected 
as too uneconomical for use as factor -test stimuli. 

Reflections — Choose the one of three alternative in- 
terpretations that correctly reflects the feeling of a tape- 
recorded statement. The factor CMI, cognition of se- 
mantic implications, was originally interpreted as one 
of conceptual foresight (Berger, et al. , 1957), while the 
parallel factor, EMI, evaluation of semantic implica- 
tions, was defined as sensitivity to 'problems (Kettner, 
et al. , 1959; Guilfcsd, et al, , 1961; Merrifield, et al. , 
1962). However, in a recent semantic-evaluation study 
(Nihira, et al. , 1964), tests that had previously defined 
these two factors were loaded together on the same fac- 
tor. Since another dimension isolated in the factor anal- 
ysis seemed more appropriately designated as factor 
EMI, the label CMI was given to the factor on which 
measures of both conceptual foresight and sensitivity to 
problems were loaded. The definition of CMI was thus 
broadened to include both foresight and sensitivity to 
problems. It seemed reasonable to expect that both be- 
havioral foresight and behavioral sensitivity to problems 
might belong to CBI. 

The hypothesis of CBI as behavioral foresight or pre- 
dictions has been covered in two tests already discussed. 
Cartoon Implications and Cartoon Predictions . As a 
measure of the sensitivity-to-problems definition of 
implications, a test of sensitivity to verbal communi- 
cations was devised. 

Of all those who are interested in the feelings under- 
lying verbal statements, nondirective therapists are 
perhaps most concerned with sensitivity to. the "real" 
intentional or emotional meaning. The Rogerian tech- 
nique of "reflecting" feeling demands this sensitivity. 
The test Reflections was based on this conception of 
reflection of feeling as one kind of behavioral sensitivity. 
In constructing the test, statements were selected from 
published reports of therapy cases. Alternative "reflec- 
tions of feeling" were chosen, with the keyed response 
being, in many cases, a reflection which the original 
therapist had noted to be a good one (Porter, 1950; 
Porter b Streich, 1963; Rogers, 1942; Snyder, 1947). 

Pretesting results indicated that the test was too dif- 
ficult for most Es, so a tape recording of the given 
statements was made to reduce their ambiguity. A 
group of non-actors, varied with respect to age, sex, 
and occupational level, read the statements with the 
appropriate inflections. In addition, the alternative 



reflections-of-feeling responses were reed so es to 
reduce reading-comprehension variance. 

This report has tended to depreciate the importance 
of verbal cues in understanding emotional behavior, an 
orientation prompted mainly by the results of previous 
research in which oVer-re liance on verbal presentation 
tended to obscure the existence of any but semantic abil- 
ities. However, it is probable that the psychotherapist 
and others concerned with person cognition do use 
verbal-behavioral cues'as often as nonverbal ones. 

SELECTION OF REFERENCE FACTORS 

In choosing the intellectual factors from which to 
distinguish the hypothesised behavioral- cognition dimen- 
sions, two general strategies were used. The most 
compelling one was to hypothesise, in broad psycho- 
logical terms, what non-behavioral abilities might be 
assessed by the experimental tests. For example , though 
efforts were made to control for this by proper test 
construction, E’s verbalisation or semantic labeling 
of nonverbal stimuli might aid in choosing the correct 
answer. This labeling ability might, in fact, be the 
major ability measured by the behavioral tests. To 
determine whether this were the case, measures of 
Adkins' (Adkins It Lyerly, 1951) concept -naming factor 
(convergent production of semantic units or NMU) were 
included in the test battery. 

Another hypothesis was that the behavioral tests pre- 
sent the examinee with exercises in problem solving 
(Moore, 1958). As a check on this possibility, measures 
of the general-reasoning factor (CMS), an important 
aspect of problem solving, were employed. 

Related to this problem-solving conjecture was the 
idea that the unusual nature of the behavioral tests might 
require some accommodation, and this characteristic 
of the tests might favor more flexible individuals. For 
this reason, measures of "creative thinking" were em- 
ployed as indirect indicators of E*s willingness to accept , 
and ability to respond to unusual situations. The factors 
thought to be related to this possible tendency were ide- 
ational fluency (DMU) and originality (DMT). Weisgerber 
(1956) reported. that accuracy in judging emotional ex- 
pressions is related to semantic expressiveness and 
verbal fluency. The inclusion of measures of these 
"creative" abilities in the final test battery was intended 
to permit replication of his findings. 

Many of the behavioral-cognition tests use Ferd'nand 
or other cartoon stimuli. Cartoon material is not neces- 
sarily behavioral material, however. Only if the car- 
toon includes dispositions such as emotions or intentions 
should it be considered a potential behavioral stimulus. 
If behavioral information is not depicted, cartoons may 
be used to assess semantic abilities. For example, a 
test based on the Louie cartoon strip has been used 
(Adkins It Lyerly, 1951) to define a semantic-ordering 
(NMS) factor. This test, called Picture Arrangement , 
was included in the present study to determine whether 
the behavioral tests, particularly those using cartoons, 
were possibly nothing but measures of cartoon or format 
"factors. " 

Since most of the behavioral tests use visual stimuli 
of one kind or another, it seemed desirable to ascertain 
whether any visual-figural abilities are involved in re- 
sponding to them. Marker tests of speed of closure 
(CFU), figure! inductive reasoning (CFR), and flexi- 
bility of closure (NFT) were used to determine this. 



The NFT factor was included for another reason as well. 
Messick and Da mar in (1963) had found that persons with 
high scores on an embedded -figures test, similar to 
Hidden Fiaures , an NFT marker test, were superior at 
recall of social stimuli, faces. It was thought desirable 
to ascertain whether this superiority exists in the area 
of cognition as well as that of memory. 

The second method of selecting reference factors was 
dictated by the more specific needs of structure -of - 
intellect factor definition. If one wishes to show that 
six behavioral-cognition factors are factorially inde- 
pendent of other structure -of-intellect factors, a con- 
vincing demonstration of this independence would be to 
separate these dimensions from all relevant factors 
having two of the three structure-of-intellect parameters 
in common with them. In this study, the differentiation 
of behavioral- cognition factors from semantic -cognition 
factors seemed probably most needed. On this basis, 
marker tests for the reference factors of CMU, verbal 
comprehension; CMC, verbal classification; CMR, ver- 
bal relations; and CMI, conceptual foresight or sensi- 
tivity to problems, were administered to all examinees. 

The marker tests selected for inclusion in the final 
test battery were chosen because each had defined a 
reference factor in the past and because each could be 
administered in a relatively short time. In an attempt 
to conserve testing time, three tests were employed 
that Es had already taken as part of their school's test- 
ing program. For example, a few months before this 
study's testing, Es had taken the Henmon-Nelson Tests 
of Mental Ability (Lamke & Nelson, 1957). To avoid the 
necessity of using a second CMU (verbal-comprehension) 
test in the final test battery, the 20 vocabulary items of 
the Henmon-Nelson test were scored. In addition, as 
a second measure of the general-reasoning factor, CMS, 
the Quantitative Thinking test in the Iowa Educational 
Development Series (Lindquist fc Bloomers, 1960)was 
used; and as an alternative CFR test, existing DAT 
Abstract Reasoning (Bennett, Seashore, It Wesman, 
1959) scores were used. Es had taken the DAT nearly 
two years prior to the present study's testing. 

The Marker Tests 

CMU - Cognition of semantic units: verbal comprehen- 
sion; knowledge of the meaning of words. 

Verbal Comprehension -— -Choose the one of five al- 
ternative words that has the same meaning as a given 
word. 

Henmon-Nelson Vocabulary — Choose the alternative 
word that has the same meaning as a given word. Choose 
the alternative word that correctly completes a given 
sentence. 

CMC - Cognition of semantic classes: conceptual clas- 
sification; comprehension of the attribute common to 
the members of a class. 

Verbal Classification — ^Decide whether each ofa 
group of words belongs with one of two classes, or with 
neither. 

Word Classification — —Choose the one of four words 
that does not belong with the other three. 

CMR - Cognition of semantic relations: understanding 
the relationships that may hold among word meanings. 

Verbal Analogies I — —Choose the one of four words 
that completes a given analogy. 
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Word Matrix Tost Choose the on* of five words 

that completes a 2 x 3 matrix of words, 

CM8 - Cognition of semantic systems: general rea- 
soning; comprehension of complex, meaningful material. 

fo** Tests of Educational Development - Quantitative 
Thinking — Solve a variety of mathematical problems. 

Ship Destination Test — rind the distance of a ship 
to a port, taking into account an increasing number of 
variables. 

CM1 - Cognition of semantic implications: conceptual 
foresight; sensitivity to problems. 

Pertinent Questions Write four questions that could 

be asked in making a decision about a given situation. 

Seeing Problems — Write five problems connected 
with the use or function of a common object. 

NMU - Convergent production of semantic units: con- 
cept naming. 

Picture -Group Naming — Write the class name for 
five pictured objects. 

Seeing Trends I — Specify the meaningful trend in a 
group of words. 

NMS - Convergent production of semantic systems: 
semantic ordering. 

Picture Arrangement Reorder a cartoon strip so 

that it makes temporal sense. 

Sentence Order — Arrange three sentences in a mean- 
ingful order.' 

DMU - Divergent production of semantic units: ide- 
ational fluency. 

Consequences - obvious — -Write many different re- 
sults of an unusual situation; only common or obvious 
outcomes are credited. 

Plot Titles - low quality — Write many different titles 
for a short story; only relevant, but unclever responses 
are credited. 

DMT - Divergent production of semantic transforma- 
tions: originality. 

Consequences - remote— Write many different results 
of an unusual situation; only indirect or uncommon re- 
sults are credited. 

Plot Titles - high quality— Write many different titles 
for a short story; only clever titles are credited, 

CFU - Cognition of figural units: speed of closure. 

Mutilated Words — Identify words in which parts of 
epch letter are missing. 

Street Gestalt Completion — Identify pictured objects 
having missing parts. 

CFR - Cognition of figural relations: comprehension 
of relationships among concrete objects, such as quasi- 
geometric figures. 

Differential Aptitude Test - Abstract Reasoning -—- 
.Choosa-the one of five alternative figures that completes 
a four -figure series. * 

Figure Matrix Test — Choose the one of five alter- 
native figures that completes a 3 x 3 matrix of figures. 



N7T - Convergent production of figural transformations: 
figural redefinition. 

Hidden Figures — Choose the one of five alternative 
figures that is hidden in a given figure. 

Penetration of Camouflage — Find the human faces 
camouflaged in the lines of a realistic drawiig. 

PROCEDURES 

The Tested Sample 

Because of the possible culturally specific nature of 
many of the test stimuli, particular care was exercised 
in choosing a group of Es. It is possible that the social 
environment of Negroes, Orientals, or other minority 
groups might unduly handicap their performance on the 
tests. On no account should this be interpreted to mean 
that such groups are inferior in social intelligence. It 
implies only the need for a control for a perhaps rele- 
vant variable. Their exclusion as Es was a precaution 
based on what was presumed to be limited experience 
with gestures or facial expressions more common to the 
white, middle-class culture. 

Other restrictions on the choice of the sample were 
that its members have at least average intelligence on 
traditional IQ tests so as to be able to follow test in- 
structions, and that they be old enough to recognise the 
social situations presented in some of the behavioral 
tests. 

The sample selected for this study included 306 
eleventh-grade students at Pasadena High School in 
Pasadena, California, a middle -class, chiefly Cauca- 
sian community. ® At the request of school officials, 
52 gifted students were included in the sample. Com- 
plete factor -analytic test information was obtained on 
the performance of 110 boys and 130 girls. The mean 
age of the final group of 240 was 16. 7 years. The aver- 
age Henmon- Nelson IQ of 229 of these examinees was 
1 17, 7 with a standard deviation of 16, 9 and a range from 
83 to 155. 

From a subsamMe of 236 Es it was learned that half 
of these students came from homes of superior socio- 
economic standing. On the Occupational Scale of 
Hollingshead's Index of Social Position (Hollingshead V 
Redlich, 1958), 135 students received ratings of 1 or 2 
(see Appendix A). 

Test Administration 

The factor tests were administered to ten classes of 
approximately 30 students each on March 10. 12. 18. 
and 19, 1964, Four testers administered the tests dur- 
ing the usual social- studies period, a double -length 
period of 111 minutes. The administrators were rotated 
so that each class had a different administrator for each 
day's testing. 7 The tests were administered in the same 
order to all E>. The superior nature of the students, 
the small, familiar groups in which testing occurred, 
and the enjoyable nature of many of the tests made for 
excellent testing conditions. 



We are very much indebted to Dr. Marcella Bonsall, 
Dr. Joseph Hansen, and Mr. Alan Dittberner for their 
help in arranging the testing at Pasadena High School. 

^ Dr. Ralph Hoepfher made invaluable contributions 
to the test administration as well as to the preparation 
of this report. 
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Cartoon Analogies CBR03A 
Cartoon Exchange CBT01A 
Cartoon Implications CBI01A 
Cartoon Predictions CBI03A 
Consequences - obvious (DMU) 
Consequences - remote DMT03B 
DAT Abstract Reasoning (CFR) 
Expressions CBU01A 
Expression Exchange CBT04A 
Expression Grouping CBC04A 
Faces CBU02A 
Facial Situations CBS03A 
Figure Matrix Test CFR02A 
Hsnmon-Nelson Vocabulary (CMU) 
Hidden Figures NFT04A 
Inflections CBU04A 
ITED Quantitative Thinking (CMS) 
Missing Cartoons CBS01A 
Missing Pictures CBS04A 
MutlUted Words CFU03A 
Odd Strip Out CBC02A 
Penetration of Camouflage NFT02A 
Pertinent Questions CMI02B 
Picture Arrangement NMS02B 
Picture Exchange CBT03A 
Picture Exclusion CBC05A 
Picture-Group Naming NMU03A 
Plot Titles - low quality DMU05A 
Plot Titles - high quality DMT01E 
Questions n CBU03A 
Reflections CBI04A 
Seeing Problems CMI03A 
Seeing Trends I NMU01A 
Sentence Order NMS03B 
Ship Destination Test CMS02B 
Silhouette Relations CBR05A 
Social Relations CBR02A 
Social Translations CBT02A 
Sound Meaning CBC06A 
Stick Figure Opposites CBR04A 
Street Gestalt Completion CFU05A 
Verbal Analogies I CMR01B 
Verbal Classification CMC02B 
Verbal Comprehension CMU02C 
Who Said It? CBT05A 
Word Classification CMC01A 
Word Matrix Test CMR02A 
Sex 

Sibling Status 
Socio-Economic Status 
Mental Age (Henmon-Nelson) 
Chronological Age 
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.. code de,l * natlon o£ tests, the first three letters refer to the hypothesised factor content of 

the teit. Letters in parentheses represent the hypothesised factor content of tests without code numbers. 

” The code for distribution forms Is the following: N. normal; P. platykurtlc; L, leptokurtlc; T, 

truncated; -, slight negative skew; +, slight positive okew; ++, strong positive skew. 

. * The^code for scaling of scores Is the following: C. C- scaled; S. stanlne- scaled; D. dichotomised 

at tne median. 

d The code for reliability estimates Is the following: K, general Kuder-Rtchardson formula; S-B, 
Spearimn> Brown estimate of whole •test reliability from lnter*part correlations; communallty as a 
lower -bound estimate of reliability. y 



Scoring 

Frequency distributions of responses to each item’ 
of the multiple -Choice tests were inspected for agree- 
ment with the rational key*** If an item- response dis- 
tribution was bimodal or platykurtic, the item was elim- 
inated in the initial scoring of the test. For each test,, 
dichotomisation of the initial test scores at the median 
identified high and low scorers, who served as the cri- 
terion groups used in item analysis* Only items capable 
of yielding positive phis were retained in the final scor- 
ing. For a few tests, this item-analysis procedure was 
repeated several times. 

In responding to the behavioral tests, an E often 
cannot verbalise or explain why he chose a particular 
answer. For this reason, some random guessing was 
suspected. Inspection of examinee -response patterns 
did not support this belief, but as a safeguard, a 
correction-for -guessing formula was applied where 
appropriate. In most cases, the formula, rights plus 
omits divided by the number of alternatives, was used. 

For each test, the total test score is the sum of the 
part scores, separately corrected for guessing. The 
exact scoring formula used for each test is given in 
Appendix A. 

Although most of the tests used in this study are ob- 
jectively scored, fourteen of them required scoring with 
varying degrees of subjectivity. Tests 20, 22, 24, 34, 
and 43 (see Table 2) are written- response rather than 
answer-sheet tests. However, their scoring is quite 
objective, so they were scored and checkscored by 
clerical workers. Tests 27, 33, and 41 were scored 
and checkscored by clerical workers and then re - 
checkscored by the senior author. 

Of the tests used in this study. Pertinent Questions . 
Seeing Problems . Plot Titles , and Consequences are the 
most difficult and least objective to score. These tests 
were first scored by an experienced, creativity-test 
scorer, and then checkscored by the first author. The 
intar-scorer reliabilities for these four tests were, 
respectively, .97, .91, .94, and. 83. Since the inter - 
scorer reliability for Consequences was relatively low, 
a list was made of all responses on which the two scor- 
ers disagreed. The disagreements were then arbi- 
trated by a third scorer, highly experienced in scoring 
Consequences . 

In this analysis, as in others, measures of the fac- 
tors DMU and DMT were obtained by scoring each of 
two tests. Consequences and Plot Titles , for two kinds 
of responses. The remote or clever answers were 
scored as measures of originality (DMT); all other 
relevant, non-duplicate responses were scored for ide- 
ational fluency (DMU). 

Originally, an attempt had been made to reduce the 
experimental dependence in this procedure. Only the 
relevant responses of one part of each test were to be 



The computations used in this study were performed 
using the Honeywell 800 at the Computer Sciences Labo- 
ratory of the University of Southern California, and the 
IBM 7094 at Western Data Processing Center, Graduate 
School of Business Administration, University of Cali- 
fornia at Los Angeles. We are indebted to Dr. Kasuo 
Nihira for hie help with the computer programs used in 
this analysis. 



scored as measures of DMU; ^ad only the remote or 
clever ones in the remaining part or parts, as mea- 
sures of DMT. In addition, since it had been indicated 
(Christensen, et al. , 1937) that instructions to be clever 
increase the number of clever or remote responses, one 
part of Plot Titles was given with directions to write 
"appropriate" titles, the other, with instructions to write 
"clever" ones. When all the relevant responses for the 
"appropriate" part of Plot Titles were scored as a mea- 
sure of DMU, however, this score correlated . 49 with 
the other part ol Plot Titles , scored for DMT and given 
under a "clever" instructional set. Some correlation 
was expected. The relevant responses included remote 
and clever ones as well. A correlation coefficient of 
this size, however, is about what holds between different 
parts scored for only one factor. Since this scoring 
procedure reduced the variance available for both fac- 
tors, and since no difference in mean cleverness was 
observed as a function of different instructional sets, 
both parts of Plot Titles were scored for both factors 
in the traditional manner. 

Ideational fluency is often thought to be syronymous 
with quantity of output, quality of product not being con- 
sidered. This is not true. As usually scored, the 
"left-over," low-quality nature of DMU cannot be 
stressed sufficiently. Under present scoring proce- 
dures, an E with 20 clever responses will have a lower 
DMU score than an E with five mediocre ones. Con- 
ceptually, DMU and DMT are independent. Operation- 
ally, this independence is forced by the way in which 
these two DMU- DMT tests are scored. The factors 
DMU and DMT, if defined only by these tests, must be 
cautiously interpreted in the light of the scoring pro- 
cedures used. 

Statistical Analysis 

The total-score distribution of each variable was 
checked for normality of distribution. If the data were 
other than normally distributed, an appropriate scaling 
technique was applied. The variables treated in this 
manner are indicated in Table 2. 

Means and standard deviations were obtained for all 
part and for all total test scores. The only scores 
available for the DAT Abstract Reasoning and the ITED 
Quantitative Thinking were nationally-normed percent- 
iles. However, for intra-table consistency, the means 
and standard deviations of these variables are reported 
in Table 2. 

Where justifiable, both a Spearman-Brown estimate 
of whole-test reliability and an estimate of internal con- 
sistency were determined for each test. If a test was 
speeded or had only one part, its communality was used 
as a lower-bound approximation to its reliability. 

The estimates obtained indicate that most of the tests 
in this battery are at least moderately reliable. Among 
the behavioral tests, two with particularly low reliabili- 
ties are auditory in nature. These tests. Inflections 
and Sound Meaning, were deliberately made easy. Pre- 
vious research (Eisenberg & Zalowitz, 1938; Fay & 
Middleton, 1942; Kramer, 1963) has indicated that there 
is little agreement among subjects when auditory stimuli 
alone are used to convey emotion. However,, in this 
study, Es agreed too readily with the key, and conse- 
quently item variance was unduly constricted. 

In correlating the total scores of all variables, the 
coefficients were based on the actual number of cases 
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for each variable. Although the majority of the coef- 
ficients were based on the whole sample of 240, scores 
fot variables 7, 14, 17, 49, 50, 51, and 52 were avail- 
able only on subsamples of 194, 229, 231, 238, 236, 
229, and 238, respectively. This used all the available 
information, assuming comparability of subjects with 
respect to correlations. 

The computer program used to determine the corre- 
lation coefficients yields Pearson product-moment r's 
for normally distributed data. Correlations between 
dichotomised and undichotomised variables would be 
point -bi serial r’s; and between two dichotomised vari- 
ables, phis would result. In order not to mix correla- 
tion coefficients in a matrix to be factor analysed 
(Guilford, 1952; Carroll, 1961), the correlations of the 
dichotomous variables with the other variables to be 
factor analysed were corrected so as to approximate 
Pearson r's. This cor rected-cor relation matrix is 
given in Table 3. 

The correlations holding among the first 47 variables, 
the variables to be factor analysed, are what might be 
•xpected of an aptitude -correlation matrix. With the 
exception of variable 28, few negatives exist. The large 
number of small and sero correlations is promising in 



light of the use of the simple -structure criterion. 

Of the correlations between sex and the other vari- 
ables significant at the .01 level, about half are in one 
direction and half in the other. The boys in this sample 
did significantly better on variables 6, 17, 29, and 33, 
all semantic tests. Since most of the gifted students 
were boys, their superiority at verbal tasks is not sur- 
prising. Although girls did better than boys on one 
semantic variable, test 5, the rest of the significant 
negative correlations are with behavioral variables, 
1, 11, 26, 37, and 38. This female superiority - 
at behavioral tasks supports other research findings 
(Bronfenbrenner, et al. , 1958; Busby, 1924; Jenness, 
1932). However, although these correlations are sig- 
nificant, the largest of them is -. 17, which indicates 
only minimal relatedness. 

Sibling status had only two significant correlations, 
both with semantic variables, tests 6 and 32. The indi- 
cation that only and oldest children do better at semantic 
tests is probably another effect due to gifted -student 
confounding, since most of the gifted students in this 
sample were only children. The striking lack of only- 
oldest superiority in behavioral tasks is in contrast to 
most findings in this area (Sears, 1950; Schacter, 1959). 
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All of the significant correlations with socio-economic 
status are negative in sign, indicating that Es of higher 
socio-economic standing performed better. Of the 22 
significant correlations, ten are with semantic variables 
and 12 with behavioral ones. Again, this could be due 
to the gifted students in the sample. 



into the diagonal of the correlation matrix, and 33 prin- 
cipal factors were extracted using the BIMD 17 program. 
The first 22 principal factors extracted were retained 
since they accounted for 95. 7 percent of the variance 
and a plot of the eigenvalues of all factors extracted 
showed a dip after the 21st one. 



The substantial correlations of many variables with 
the complex mental-age estimate from the H<?nmon- 
Nelson test (variable 51) is to be expected. The cor- 
relations with chronological age indicate a general eu- 
periority of the younger Es. This need not mean that 
social intelligence decreases with age. The correlations 
seem better explained in terms of the age of the gifted 
students, who, as a group, were below age for their 
grade placement. 

The Factor Analysis 

The correlation matrix of the first 47 variables in 
Table 3, with the highest correlation in each column 
entered in the diagonal, was submitted to an iterated- 
communality program. Communalities tended to sta- 
bilise after six iteration cycles, so these communality 
estimates were employed in the extraction process. 
The iterated-communality estimates were then inserted 



A varimax rotation of. these 22 factors yielded three 
factors. The largest one had loadings only of 
semantic tests, the next largest, mainly of behavioral 
tnsts, and the third, only of figural markers. The re- 
maining factors were uninterpretable doublets. This 
is a typical varimax solution and one not suited to an 
examination of the hypotheses of this study. Patterned 
equamax rotations of 22 factors in one case, and of 18 
(the hypothesized number) in another, were also tried. 
These solutions yielded uninterpre table factors with 
little positive manifold and no simple structure. Since 
all factors were not equally represented in the test bat- 
tery, such a finding was not unexpected. 

The 22 principal factors were then submitted to an 
orthogonal rotation program designed to maximize the 
similarity of the empirical factor matrix to a target 
matrix of loadings (Cliff, 1964). The initial target 
matrix was patterned in line with the experimental 
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hypotheses, using the square root of each test's com* 
munaUty as its target loading. These loadings were 
••lected to maximise not only the emergence of the 
hypothesised factors, but more importantly, to achieve 
simple structure (Thur stone, 1947) and to maintain 
positive manifold. 



most often lost its CMC univocalness to CMU. This is 
not particularly true here. Verbal Classification has 
most often been complicated by having loadings on the 
CMR factor (Kettner, et al. , 1959) as here. 

CMR Cognition of semantic relations 



However,' the rotated factor matrix of 22 factors did 
not maintain communalities, nor did it permit repro- 
duction of the correlation matrix. The program is a 
simple one, designed to perform arithmetic, more spe- 
cifically matrix algebra. The eigenvalues of the last 
factors might have been too small to permit computa- 
tional accuracy* To determine if this were the case, 
successively smaller numbers of factors were submitted 
for algebraic rotation. The largest number of factors 
capable of maintaining communalities was 19. This 
number of factors was retained because better simple 
structure was achieved with it than with a smaller num- 
ber. These 19 principal factors account for 92. 5 per- 
cent of the variance and are given in Table 4. 

The final target matrix (see Appendix B) was quite 
similar to the initial one described above. The sizes of 
some loadings were changed slightly and not all vari- 
ables were patterned in line with original hypotheses. 
Changes in the final target matrix were decided pri- 
marily on th i basis of simple -structure dictates. • The 
rotated factor matrix obtained in this way is given in 
Table 5. The accuracy of this solution may be seen in 
the agreement of the communalities of the unrotated and 
rotated matrices. There is only one difference as large 
as . 02, easily accounted for in terms of rounding error. 
The post-multiplication of the rotated factor matrix by 

transpose reproduced the correlation matrix almost 
perfectly. The frequency distribution of differences 
between the original and the reduced correlation matrix 
*** leptokurtic about a mean of zero with a range from 
plus to minus . 05. 



47. Word Matrix Taat (CMR) . 55 

42. Varbal Analogic* 1 (CMR) . 37 

31. Reflection* (CBI) .35 

43. Verbal Classification (CMC) . 33 



(CBI .36) 
(CMC . 49) 



Although there is some confusion with the CMC fac- 
tor, the strong loading of Word Matrix Test and the 
unique loading of Verbal Analogies I clearly define this 
as the predicted reference factor, CMR. 

Also loaded on this factor is the only behavioral test 
that has a significant non-behavioral loading. That this 
particular behavioral test should be loaded on a semantic 
factor is not surprising. A high score on Reflections, 
which is hypothesized to measure the behavioral- 
implications factor, depends relatively little on correct 
interpretation of vocal inflections. The more essential 
task is an understanding of the subtle uses of language 
to convey emotion or feeling. The position of subject 
and verb in the sentence and the length of the sentence 
are but two of the cues writers may use to convey emo- 
tion or to delineate character. Just how relations are 
involved in this test is not clear. 

Translations , another behavioral test presented 
in verbal form, does not have a significant loading on 
this factor, but a loading of . 28 suggests that this be- 
havioral test also demands a bit of verbal adroitness. 

CMS Cognition of semantic systems 

17. ITED Quantitative Thinking (CMS) .65 
35. Ship Destination Teat (CMS) . 37 

13. Figure Matrix Te*t (CFR) . 33 (CFR . 37 ) 



INTERPRETATION OF THE FACTORS 

Tb* factors found in this study will be discussed pri- 
marily in terms of tests having loadings of . 30 or great- 
®r on them. The choice of . 30 as a "significant" factor 
loading was made on the basis of convention. The fac- 
tors will be discussed in the order in which they are 
presented in Table 5. First the reference factors, se- 
mantic and figural, will be given, then the experimental- 
behavioral factors. 

Reference Factors 

CMU Cognition of semantic units 

44. Varbal Comprehension (CMU) . 71 

14. Henmon-Nelson Vocabulary (CMU) . 65 

Verbal Comprehension and Henmon -Nelson Vocabu- 
lary clearly define this as the unfailing verbal- 
comprehension factor. No other semantic tests had 
significant loadings on it, and, what is mpre encouraging, 
no behavioral tests involved CMU significantly. 

CMC Cognition of semantic classes. 



43. Verbal Classification (CMC) .49 

44. Word Classification (CMC) • . 36 

34. Santanca Order (NMS) . 30 



(CMR . 33) 



Earlier factor analyses have had some difficulty in 
separating tests designed as markers for the factors 
CMU, CMC, and CMR, There is just a little of such 
confusion here. In the past. Word Classification has 



• ITED Quantitative Thinking and Ship Destination Test 
were the two measures hypothesized to define the 
general-reasoning factor, CMS. The significant load- 
ings of both these tests on only this factor satisfactorily 
define it as such. 

The loading of Figure Matrix Test on the same factor 
»• Ship Destination Test is not a new finding (Guilford, 
et *1. , 1951; Hertzka, et al. , 1954). Both tests have 
previously loaded together on a factor called eduction 
of perceptual relations, later identified as CFR. Al- 
though Figure Matrix Test helped define its hypothesized 
■factor, CFR, its loading on CMS would not argue well 
for its univocality. 

Relevant to the purposes of this study is the fact that 
three fourths of the tests designed as measures of be- 
havioral intelligence are in the hyperplane of this factor. 
Superior general-reasoning ability would not seem es- 
sential to superior performance on the newly devised 
behavioral- intelligence tests, a point about which there 
had been some concern. 

CMI Cognition of semantic implications 

32. Seeing Problems (CMI) . 57 

23. Psrtlnsnt Questions (CMI) .41 

5. Consequences - obvious (DMU) . 40 (DMU . 45 ) 

In discussing the construction of the CBI tests, the 
recent (Nihira, et al, , 1964) merging of the conceptual- 
foresight and sensitivity- to-problems factors was men- 
tioned, The CMI factor found in this analysis is led by 



O 
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Seeing Problems , formerly considered an EMI 
(sensitivity-to-problems) marker test. Loaded with 
Seeing Problems is Pertinent Questions , a traditional 
CMI marker variable. The unique loadings of these 
tests on the same factor lends strong support to the 
broadening of the definition of factor CMI to include 
both foresight and sensitivity to problems. 

The significant loading of Consequences - obvious on 
factor CMI should be noted. Although Consequence s - 
obvious has been loaded with both Seeing Problems and 
Pertinent Questions in other analyses (Berger, et al. , 
1957; Guilford, et al. , 1961), its loadings have always 
been barely significant, and, therefore, easily over- 
looked. Viewing Consequences - obvious as a measure 
of CMI is quite sensible. Conceptual foresight would 
seem called for when one is asked "What would be the 
results if. , . ?" There is a great deal of similarity 
among the tasks of Consequences , Seeing Problems , 
•nd Pertinent Questions (see Appendix A). All three 
tests actually ask E to anticipate consequences of one 
kind or another. 

» » 

It may be that Consequences - obvious has not been 
loaded more strongly with Pertinent Questions and See- 
ing Problems in the past because these two tests have 
not both been used to define the same factor in a test 
battery which included Consequences until now. With 
the strengthening of the CMI factor, howevei, the re- 
lationship of Consequences to it is made more obvious. 

DMU Divergent production of semantic units 

2t. Plot Titles - low quality (DMU) • 69 

5. Conssqutnces - obvious (DMU) , 45 (CMI . 40) 

Plot Titles - low quality and Consequence a - obvious 
define this factor as that of ideational fluency, DMU. 
The relation of Consequences - obvious to the CMI factor 
has just been pointed out. 

DMT Divergent production of semantic transformations 

6 . Consequence* - remote (DMT) . 69 

29. Plot Titles - high quality (DMT) . 43 

The originality factor in this analysis was led by 
Consequences - remote and further defined by Plot 
Titles - high quality, as anticipated, with no significant 
secondary loadings. 

NMU Convergent production of semantic units 

33. Seeing Trends I (NMU) .37 

27. Picture-Croup Naming (NMU) . 35 

The concept-naming factor is uniquely defined by its 
two marker tests, Seeing Trends I and Picture -Group 
Naming. It should be noted that no behavioral tests are 
loaded on this factor, indicating that tfris form of ver- 
balization ability is not essential to the tasks presented 
in the behavioral tests. It is still possible that if a 
behavioral test required naming of expressions it would 
be loaded on NMU. The care taken to avoid this seems 
to have been worthwhile. 

NMS Convergent production of semantic systems 
24. Plcturs Arrangement (NMS) . 67 

Although both Picture Arrangement and various forms 
of Sentence Order have consistently defined the semantic- 
ordering factor, NMS (Berger, et al. , 1957; Guilford, 
et al. , 196l; Petersen, et al. , 1963), these two tests 
did not cohere in this factor analysis. (Sentence Order 
had a barely significant loading on the CMC factor. ) 
The shortened form of Picture Arrangement used in this 



study proved to be very easy for the Es. Most of them 
got perfect scores. Sentence Order , on the other hand, 
was moderately difficult, with no one achieving a perfect 
score. This difference in difficulty might be the reason 
for the separation of the tests. 

This singlet is considered to be the hypothesized NMS 
factor because of the high, unique loading of Picture 
A r range ment on it. Although Picture Arrangement is 
a test composed solely of cartoons, none of the 
behavioral- cartoon tests is loaded with it. The fact that 
the cartoon tests are not all loaded on the same factor 
is at least partial proof that the kind of stimulus used 
is not the most important element in the testing situa- 
tion. The content, in the SI sense, of the kind of intel- 
lectual material to be processed, whether semantic or 
behavioral, is of greater -significance. 

CFU Cognition of figural units 
41. Street Gestalt Completion (CFU) .45 

20. MutlUted Words (CFU) . 45 (NFT . 34) 

Street Gestalt Completion leads the speed-of-closure 
factor, Thurstone's Closure} (Thur stone, 1944), with its 
unique loading of . 45. Mutilated Words , the other 
marker test of CFU, has its highest loading on this fac- 
tor, but has a side loading on NFT as well. 

The flexibility-of-closure factor, NFT, is led by 
Penetration of Camouflage . Street Gestalt Completion . 
Mutilated Words , and Penetration_^f^amouflage have 
been found loaded on the same factor before (Guilford, 
et al. , 1952). The fact that Mutilated Words split be- 
tween the CFU and NFT factors in this analysis is there- 
fore not unprecedented. • 

CFR Cognition of figural relations 

7. DAT Abstract Reasoning (CFR) . 66 

13. Figure Matrix Test (CFR) .37 (CMS .33) 

The figural- relations factor is led by DAT Abstract 
Reasoni ng. Although Figure Matrix Test is also loaded 
on the CFR factor, it is not unique to this factor. The 
factorial complexity of Figure Matrix Test may be ex- 
plained by the greater complexity of its task. In the 
DAT Abstract Reasoning test, the figural relation in 
each item is a one-way trend. In Figure Matrix Test , 
trendu in two directions must be considered. 

NFT Convergent production of figural transformations 

22. Penetration of Camouflage (NFT) . 45 
15. Hidden Figures (NFT) . 39 

20. Mutilated Words (CFU) . 34 (CFU . 45) 

Flexibility of closure (Thurstone's Closure 2 ) is defined 
by the unique loadings of its two hypothesized marker 
Penetration of Camouflage and Hidden Figures . 
Although both marker tests have unique loadings on fac- 
tor NFT, this factor does exhibit some lack of confor- 
mance to simple structure, as shown by the one stray 
relationship with Mutilated Words . 

Considering (hat most of the behavioral 'test stimuli 
*re visuel-figural, it is relevant that none of the behav- 
ioral variables has a significant loading on any of the 
three figural reference factors. 

Experimental Factors 

CBU Cognition of behavioral units 



15. Missing Csrtoons (CBS) 
11. Fscss (CBU) 

16. Inflections (CBU) 

S. Expressions (CBU) 

30. Questlens 11 (CBU) 



.41 (CBS .52; CB1 .35) 

.40 

. 3S 

.36 

.34 
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Although the behavioral-units factor is led very 
slightly by Missing Cartoons , a test designed to mea- 
sure CBS, the other four tests defining it are those 
hypothesised to do so. Missing Cartoons is a complex 
test, as may be seen from its pattern of correlations. 
To answer the items of this test correctly, attention 
must be paid to the expressions of each cartoon charac- 
ter. In the light of this consideration, its loading on 
CBU is not amiss. 

Three of the other four tests defining the CBU factor, 
Faces, Inflections , and Questions II , assess mainly the 
ability to understand facial expressions. Inflections * 
was devised to discover whether a vocal inflection could 
be used to indicate a behavioral unit. However, item 
analyses indicated that the test's difficulty lay not in the 
tape-recorded inflections, but in the drawings of the 
matching facial expressions. 

The fourth test. Expressions , uses a variety of ex- 
pressions not exclusively facial. Expressions has a 
significant loading on the CBU factor, but its loading of 
. 27 on factor CBC is nearly as high. As will be seen, 
a characteristic common to the tests defining factor 
CBC is that each presents E with a variety of expres- 
sional modes. The ability to understand that different 
modes of expression may convey the same social mean- 
ing is an important feature of the tests of factor CBC. 

Expressions is the only behavioral-units test in which 
any but facial expressions were effectively used. Its 
factor -loadings pattern is not strongly univocal on CBU. 
Three of the five tests defining the CBU factor are con- 
cerned almost exclusively with interpretation of facial 
expression. For these reasons, the CBU factor might 
be regarded, in this analysis, as the ability to under- 
stand facial expressions. It will require a new analysis 
in which one or more tests composed of non-face ex- 
pressions also appear to decide upon the generality of 
the CBU factor. 

CBC Cognition of behavioral classes 

10. Expression Grouping (CBC) .59 

24. Picture Exclusion (CBC) .41 

Expression Grouping , a test composed of drawings, 
end Picture Exclusion , a test with a photographic format, 
clearly define the hypothesised behavioral- classes fac- 
tor. Considering in addition the . 27 loading of Expres- 
sions . the CBC factor is interpreted as the ability to 
cognise different modes or units of expression as com- 
municating the same thought or feeling. As with factor 
CBU, this interpretation of the CBC factor applies to 
the dimension isolated in the present analysis. Theo- 
retically, the ability to cognise behavioral classes might 
also be measured by tests in each of which only one be- 
havioral modality is used. Single-mode CBC tests, 
unlike single -mode CBU tests, would not require pre- 
cision in matching the behavioral units used. Instead, 
in the CBC tests, E would have to cut across the specific 
social meaning of each behavioral unit to comprehend 
the underlying feeling, motivation, or dispqsition shared 
by all of them. 

Odd Strip Out , intended as a test of the ability to 
classify systems of behavior, is not loaded on this facton 
This finding tends to support the interpretation of CBC 
as a classing-of-units factor. 

Sound Meaning , another hypothesised CBC test, in 
which three emotive sounds are to be classed ver- 
bally designated, has no significant loading on any factor. 



The low reliability of this test is at least a partial ex- 
planation for this occurrence, 

Sound Meaning's loadings on factors CBC, CMU, and 
NMU, although small (about . 22), deserve some com- 
ment. Sound Meaning is the only CBC in which only 
one behavioral mode, emotive sound, is used. Although 
this test is not loaded significantly on its hypothesised 
factor, considering its low reliability, its . 22 loading 
on CBC lends some support to the view that CBC may 
include more than multi-mode behavioral classification. 

Although the alternative words used in Sound Meaning 
were chosen to be maximally disparate, the loadings of 
this test on the CMU and NMU factors indicate that ver- 
bal variance was not sufficiently controlled. These 
verbal-factor loadings call to mind the difficulties with 
earlier social- intelligence tests which also used verbal- 
labeling procedures. 



CBR Cognition of behavioral relations 



57. Social Rotations (CBR) . SO 

34. Silhouette Rotations (CBR) .40 

I. Cartoon Analogies (CBR) . 37 

40. Stick Figure Opposites (CBR) . 34 

30. Social Translations (CBT) , 34 



(CBT .51) 



All four of the tests designed as measures of the 
ability to cognise behavioral relations are univocally 
loaded on this factor. The two tests leading on factor 
CBR, Social Relations and Silhouette Relations , were 
especially constructed to assess the ability to understand 
two-person interaction. Theqe tests have higher and 
more univocal loadings than the other two CBR tests, 
and if attention were restricted to these two tests, the 
factor might be interpreted as ability to cognise diadic 
interactions, but two tests of other types speak for 
greater generality for the factor. 



Cartoon Analogies also tested the ability to compre- 
hend pair relationships to some extent, but most of the 
relations on which the items were based depended on 
behavioral situations rather than on one-to-one inter- 
actions. The expressional units used in Cartoon Analo- 
gic* were more difficult to cognise than the schematic 
ones used in Social Relations and Silhouette Relations . 
This may be the reason Cartoon Analogies is loaded in 
the . 20* s on most of the other behavioral factors and is 
not loaded more highly on factor CBR. 

Stick Figure Opposites was constructed to test the 
hypothesis that one kind of relation, opposition, could 
be effectively used in a relations test. The loading of 
this test on the CBR factor indicates that this may be the 
case. The oppositions, of course, are along different 
variables of feeling, such as excited-calm and tense - 
relaxed. A loading of . 27 on factor CBU indicates that 
understanding of the individual postures used has some 
slight bearing on success in this test. 

The significant loading of Social Translations , a test 
hypothesised to measure CBT, while unexpected, is 
easily explained. In this test, the task emphasis is on 
the different social meanings that a statement may have 
when expressed between different pairs of people. Al- 
though the cognition of the statement's transformation 
is an essential operation, this cognition could not occur 
unless one understood the kind of relationship usually 
holding between the alternative pairs. Cognition of the 
diadic relation is basic to cognition of the given trans- 
formation. 
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CBS Cognition of bthavion! systems 



It. Missing Pic turns (CBS) 

It. Missing Cartoons (CBS) 

II. OM Strip Out (CBC) 

It. racial Situations (CBS) 
y Cartoon Implications (C9I) 



. »S 

.52 (CBU .41; 

.50 

.42 

.41 



CBI 

(CBT 



.35) 

.34) 



(CBI .30) 



The three tests constructed to measure CBS, the 
comprehension of an integrated social situation, are 
loaded on this factor. Missing Pictures , a pictorial 
test, seems to be the best measure of factor CBS, prob- 
ably because its item situations are fairly gross, and 
little skill is necessary to understand the individual 
expressions used* 

Missing Cartoons also has a high loading on this fac- 
tor. Yet despite its format, which is very similar to 
that of Missing Pictures , a univocal CBS test, Missing 
Cartoons is the most complex test in this battery. In 
answering most of the items in Mi_ssin^_Cartoon8 , E 
must attend closely to each cartoon character's facial 
expression. How the pivotal character feels may de- 
termine the start or finish of many of the cartoon strips. 
Missing Cartoons ' loading on factor CBU is thus not 
surprising. In Mining Pictures , on the other hand, 
since unskilled actors were used, greater reliance was 
placed on the social situation itself to convey the behav- 
ioral information. 

Missing Cartoons ' loading on the CBI factor is also of 
interest. Of the cartoon panels which are to be placed 
in the sequences of Missing Cartoons , one third of them 
are the fourth or last cartoon in the strip. The task for 
these items would be very like that in Cartoon Predic- 
tions, a test hypothesised to measure CBI. E is to 
predict what will happen, what will follow from a given 
situation. Furthermore, the prediction could possibly 
be made from only one or two preceding scenes, without 
grasping the whole story. 

Conversely, only one third of the items in Cartoon 
Implications, hypothesised to measure CBI, are of the 
what-will-happen, predictive type. The remaining items 
^ Cartoon Implications refer to what led up to or pre- 
ceded the given situation. These "precedent" items 
organise or explain the given situation. Such reasoning 
may explain why Cartoon Implications is loaded signif- 
icantly on factor CBS. and why Missing Cartoons is 
loaded on the CBI factor. 

Considering the splitting of these two tests between 
factors CBS and CBI, it is suggested that behavioral 
implications be defined as behavioral predictions. When 
one makes a prediction, there is usually no way of im- 
mediately checking one's response. In understanding 
systems, however, one can compare both ends with the 
middle, thus verifying the consistency of one's struc- 
turing. Unless the behavior in the strip is highly over- 
determined, cartoon strips with the last panel missing 
would not seem to be suitable stimuli for testing com- 
prehension of behavioral systems. 

Situati ons is a photographic test, similar in 
format to Social Relations , the leading CBR measure. 
The significant loading of Facial Situations on the CBS 
factor may be taken to mean that two people may con- 
stitute a system rather than a relationship, so long as 
they are reacting to a third stimulus rather than to one 
another. 



systems comprehension. Odd Strip Out is not loaded 
at all on its hypothesised CBC factor, but exhibits much 
of its variance on this behavioral- systems factor. It 
seems that understanding the systems in Odd Strip Out 
is the most important aspect of the task for individual 
differences. 

Three of the four tests that use Ferd'nand cartoons, 
Missing Cartoons . Odd Strip Out , and Cartoon Implica- 
tion*. ere loaded on this factor. This cluster might 
lead one to think that the CBS factor is essentially a 
Ferd'nand dimension. However, the substantial, univo- 
cal loadings of two photographic tests, Missing Pictures 
end Facial Situations , refute such an interpretation. It 
is more likely that factor CBS reflects a behavioral 
ability than one based on format or on subject matter. 

CBT Cognition of behavioral transformations 



25. Picture Exchange (CBT) 

34, Social Translations (CBT) 

9. Expression Exchange (CBT) 

2, Cartoon Exchange (CBT) 

21. Odd Strip Out (CBC) 

7. DAT Abstract Reasoning (CFR) 
45. Who Said It? (CBT) 



. 51 
. 51 
.43 
.40 
. 34 
. 34 
. 32 



(CBR .34) 



(CBS .50) 
(CFR .66) 



The hyperplane of this factor, identified as the hypoth- 
esized CBT factor, is not as dense as simple structure 
would demand. The relatively large number of tests 
designed to measure it, and the consequent over- 
determination of the factor may be held partially account - 
Able. Another reason for the large number of loadings 
in the . 20' s on this factor may be the nature of the tests 
used to measure behavioral transformations. 

The five CBT tests include transformations of units 
(Expression Exchange . Who Said It? ), relations (Social 
Translations ), and systems ( Cartoon Exchan ge. Picture 
Exchange ). Comprehension of each of these product 
categories underlies comprehension of a transformation 
performed on it. Although attempts were made to con- 
trol for this fact, some factor complexity was expected. 

Three of the five behavioral-transformations tests 
have univocal and substantial loadings on this factor. 
Picture Exchange and Cartoon Exchange involve under- 
standing a change or redefinition in the meaning of a 
social system. Expression Exchange is a measure of 
one's ability to cognise that the same gesture (an ex - 
pressional unit) may convey many different emotional 
states. Since tests of both transformed units and trans- 
formed systems uniquely define this factor, it would 
seem that interpretation should reflect the fact that a 
transformation occurred, regardless of the product 
transformed. 

Social Translations , in which the behavioral meaning 

a verbal statement is redefined, also has a substantial 
loading on factor CBT, This loading is further evidence 
fbat the transformation, rather than the transformed 
object, is the element common to the variables loaded 
on factor CBT. Social Translations ' side loading on 
factor CBR has already been discussed. 



In pretesting Odd atri p CXit. it was obvious that this 
classes -of- systems test demanded a great deal of 



Although the humor test, Who Said It? , did emerge 
on its hypothesized behavioral factor, its loading is 
minimal. This low loading may be attributed to the 
test's low reliability. That Who Said It ? was loaded at 
all as hypothesised, however, is encouraging. Con- 
ceptualising humor as a kind of cognition is not a com- 
mon approach, and may prove ultimately to be a useful 
one. t 



O 

ERIC 



26 



Odd Strip ^it's main loading is on tha CBS factor. 
A . 54 on the behavioral-transformations factor may be 
traced to a certain feature of the task E is given in this 
test. E is asked to choose the one of three cartoon 
strips in which Ferd'nand behaves differently than he 
does in the other two. In other words, E must cognise 
a change or transformation in Ferd'nand' s personality. 



that was previously undiscovered, marker tests for as 
many reference factors as were thought germane were 
included in the test battery. Nine factors of semantic 
or verbal ability were measured, including three fac- 
tors of creative thinking. Since many of the behavioral 
tests used visual stimuli, measures of three figural- or 
' spatial-ability factors were included as well. 



CBI Cognition of behavioral implications 



4. Carlo** Prediction* (CBI) 
11. Reflection* (CBI) 

It. Ml**lng Cartoon* (CBS) 

J. Cartoon Implication* (CBI) 



.55 

. J6 (CMR . IS) 

. 3S (CBS .S2; CBU .41) 
. SO (CBS . 41) 



In discussing the CBS factor, it was suggested that 
although implications is usually defined to include both 
antecedents and consequents, behavioral implications 
might be better defined to exclude behavioral anteced- 
ents. It was argued that when the consequents are 
given and the antecedents are to be determined, E may 
justify one end of the sequence against the other. It was 
felt that this organisation of a whole is more appropri- 
ately considered a behavioral system. The word im- 
plications implies lack of certainty, open-endedness. 
The probabilistic nature of behavioral predictions makes 
them admirable occupants of the behavioral-implications 
cell. 

The failure of the antecedent -implications test, Car- 
toon Implications , to be loaded strongly on the CBI factor 
might be attributed to some weakness in the test, rather 
than in the idea of antecedent implications. Remember- 
ing that CMI is also called conceptual foresight, behav- 
ioral foresight may be equally acceptable as an alter- 
native name for CBI. 

Cartoon Predictions was designed to test the conse- 
quences or predictions definition of behavioral implica- 
tions. Given a cartoon situation, E is to decide what 
will probably happen next. Cartoon Predictions has a 
strong, unique loading on the CBI factor. Caution should 
be exercised in making an interpretation on the basis of 
essentially one test and one loading, but in the interest 
of parsimony the CBI factor in this analysis is taken to 
reflect the ability to make predictions about others' 
behavior. 

Reflections was designed to test the alternative CBI 
definition of behavioral sensitivity-to-problems. In this 
test, as well as in the prediction-implications test. 
Cartoon Predictions , a probabilistic aspect may be 
detected. Many of the alternative reflections are only 
subtly different. Reflections ' loading on the semantic- 
relations factor is as large as its behavioral loading. 
Although Reflections seems to measure some aspect of 
CBI, the scope of CBI was not fully explored in this 
analysis. Therefore, statements as to whether sensi- 
tivity to behavioral problems is a CBI aptitude must 
await further research. 



DISCUSSION 

The purposes of this study were (1) to demonstrate 
the existence of a factorial domain which could be called 
social intelligence or behavioral cognition, (2) to estab- 
lish that this factorial domain includes the six factors 
of behavioral cognition predicted by the structure -of- 
intellect model, and (3) to provide reliable, factorial!) 
unique measures of these six behayioral-cognition 
factors. 

h order to establish that the hypothesised behavioral- 
cognition factors define an area of intellectual ability 



Table 6 shows that the 18 obtained factors (12 refer- 
ence factors, plus six behavioral factors) correspond 
closely to the 18 factors hypothesised. Considering 
the highest, significant loading of each test, only four 
of the 47 tests used in this analysis were not loaded as 
hypothesised. 

The 12 reference factors hypothesized are easily 
identified. These reference dimensions Were chosen 
to sample all known intellectual factors that might be 
relevant to the behavioral-test tasks. Therefore, the 
newly found behavioral-cognition factors may justly be 
said to reflect abilities separate from previously recog- 
nised intellectual abilities. 

All six of the behavioral- cognition factors hypothe- 
sised were identified in this analysis, although no social- 
intelligence dimensions had been discovered earlier. 
The success of the structure of intellect in this previ- 
ously uncharted area lends significant support to its 
value as a heuristic model. 

Reference Factors 

Although the 12 hypothesized reference factors 
emerged in this analysis, in some cases they did so 
despite lack of univocalness in their marker tests. This 
lack of marker-test uniqueness is noted here, because 
in almost every instance these same tests have demon- 
strated their factorial complexity in earlier studies. 

Particularly noteworthy in this regard is the con- 
fusion of the marker tests for factors CMC and CMR. 
In the Interpretation-of- Factors section, the continuing 
(over many studies) complexity of Word Classification 
and Verbal Classification was pointed out. The need 
for less complex marker tests of factor CMC is obvious. 
Among the figural reference factors, the complexity of 
Fiaure Matrix Test . Hidden Figures , and Mutilated 
Words is, again, not a new finding. 

An inter-factor confusion that is specific to the pres- 
ent study is that holding among the creativity factors, 
CMI, DMU, and DMT. Although this confusion might 
be the result of an artifact in the present study, it is 
more likely the result of a change in the definition of 
factor CMI. As noted earlier, Consequences , a DMU- 
DMT marker test, has several times shown a predilec- 
tion for going with factor CMI or conceptual foresight. 
The expansion of the CMI factor to include sensitivity 
to problems seems to have increased Consequences' 
attraction to it. The more than minimally significant 
loading of Consequences - obvious on factor CMI calls 
for a reexamination of this test's factorial composition. 

Relevance of the Reference Factors to the Interpretation 
of the Behavioral Factors 

Although some of the marker tests used in this study 
are not as univocal as is theoretically possible, the 
strong definition of most of the reference factors is 
apparent. Based on this distinct emergence of the 
semantic- and figural- intelligence factors, some com- 
ments of relevance to the interpretation of the behavioral- 
cognition factors may be made. 
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Hypothesized (actor content. 



Verbal comprehension, factor CMU, is widely re- 
garded as the major component of the traditional con- 
cept of general intelligence. Of the 24 behavioral- 
cognition tests, only one is loaded higher than . 15 on 
this factor. There is little doubt that whatever the be- 
havioral tests measure, it is not general intelligence. 

Factor CMR reflects the ability to understand rela- 
tions among semantic units or ideas. Roughly speaking, 
it may be said that this factor reflects verbal sophisti- 
cation, the ability to understand that the relation between 
words can change their individual meanings. The two 
behavioral tests that use verbal-behavioral stimuli, 
Reflections and Social Translations , have loadings 
greater than . 28 on this factor. Of course, these tests 
are significantly loaded on their hypothesized behavioral 
factors as well. These loadings on a semantic-relations 
factor support the view that verbal presentation of behav- 
ioral stimuli in a factor test is not advisable. The two 
kinds of abilities, semantic and behavioral, may be as 
mixed in real life as they are in these tests. In demon- 
strating the factorial independence of the one from the 
other, however, a test constructor does well to separate 
them. f 



to define a semantic factor on which none of the behav- 
ioral tests using drawings is loaded. Early in this 
report, it was noted that words need not be semantic 
nor need pictures be behavioral. Factor NMU found in 
this analysis lends support to this distinction, as well 
as to the interpretation of the behavioral-cognition fac- 
tors as ability isolates rather than format factors. 

The semantic -ordering factor, NMS, was assessed 
in the present study because one of its marker tests, 

Picture Arrangement , requires E to reorder cartoon i 

•trips. The identification of factor NMS in this analysis 
depended on the high, unique loading of this variable 
» lon «. Sentence Order, the other NMS marker test, < 

did not emerge on its hypothesized factor; reasons for 
this were suggested in the preceding section. The high 
loading of the cartoon test, Picture Arrangement , how- 
® ver i ie sufficient to define the factor for present pur- 
poses. All five of the behavioral-cartoon tests (Cartoon 
Exchange , Cartoon Implications . Cartoon Predictions . 

Missing Cartoons , and Odd Strip Out ) are in the hyper- 
plane of this cartoon-test singlet. In this analysis, the 
ability to manipulate cartoons would not seem to be a 
separate ability. 



With the exception of two CBT tests, most of the 
behavioral-cognition tests are in the hyperplane of factor 
CMS or general reasoning. This factor -loadings pattern 
suggests that general reasoning is not essential for 
superior performance on the social-intelligence tests 
constructed for the present study. 

No behavioral test has a significant loading on the 
CMS factor, but Cartoon Exchange and Picture Exchange 
are loaded more than • 25 on it. Both of these behavior al- 
t r *nsformations tests involve transformations of sys- 
tems. E must comprehend all parts of the given system 
as well as whether a change in one of these parts will 
have an effect on this whole. In Ship Destination Test , 
a marker test for factor CMS, E must also handle a 
large number of variables. With hindsight, it is not 
surprising that these two particular behavioral- 
transformations tests should be loaded in the . 20' s on 
general reasoning. 

The general comment to be made about the creativity 
triad of factors CMI, DMU, and DMT is that neither 
sensitivity to problems, semantic fluency, nor origi- 
nality is involved in answering the items of the 
behavioral-cognition tests. This finding contradicts an 
earlier report of correlation between semantic fluency 
and expressiveness and the ability to judge emotion 
(Weisgerber, 1956). 

None of the behavioral- implications tests is loaded 
on the semantic -implications factor, CMI. Although 
the factors CMI and CBI have the operation of cognition 
Mid the product of implications in common, the content 
involved distinctly separates these two intellectual 
abilities. 

NMU is the concept -naming dimension. This factor 
was included in the present analysis to determine wheth- 
er the ability to verbalise accurately is important in 
answering the behavioral-cognition tests. No behav- 
ioral test is significantly loaded on this factor, so it 
would seem that the behavioral tests in this study do not 
involve labeling ability. 

One of the marker tests for factor NMU, Picture - 
Group Naming , uses drawings of meaningful objects, 
rather than words. Yet, Picture -Group Naming helped 



The three figural factors, CFU, CFR, and NFT, 
were included to determine whether figural or spatial 
ability were involved in correctly answering the 
behavioral-cognition tests, since most of the behavioral- 
test stimuli are in the form of photographs and drawings. 
Since no behavioral test is significantly loaded on any of 
the three figural-ability factors, it would seem that 
spatial factors are not appreciable components of what 
is measured by the behavioral-cognition tests. 

Behavioral Factors 

Before discussing the behavioral -cognition factors 
individually, some general comments about them are in 
o^der. Most of the behavioral measures use stimuli 
not commonly used in aptitude tests. The factors result- 
ing from tests based on such unusual stimuli might be 
thought to reflect the stimuli used rather than the ability 
hypothesized. As counter -evidence, the definition of 
semantic factors by semantic tests using drawn and 
cartoon material has already been mentioned. In ad- 
dition, it should be recalled that an attempt was made 
to control for the emergence of stimulus factors by 
counterbalancing kind of stimuli over the behavioral- 
cognition factors. Each of the six behavioral-cognition 
factors isolated in this analysis is defined by at least 
two tests having different stimuli. An interpretation of 
these behavioral-cognition factors as stimulus factors 
would thus be unfounded. 

The behavioral-units factor (CBU), as found in this 
study, could be interpreted, parsimoniously, as the 
ability to understand facial expressions. This inter- 
pretation would not mean that the behavioral unit need 
be reconceptualized to exclude gestures, body postures, 

inflections. Instead, a format should be used for 
the units tests that includes more variety of expressions 
than those used in the present study. More explicitly, 
each behavioral-units test should be limited to one ex- 
pressional modality. To test the understanding of in- 
flections, for example, auditory alternatives should be 
used. The*promise for success in using different kinds 
of expressions in CBU tests is supported by the .27 
loading on factor CBU of Stick Figure Opposites , a CBR 
test, fin Stick Figure Opposites , cognition of a given body 
posture is tested using three body-posture alternatives. 
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The CBC factor found in this study is defined as 
reflecting the ability to see similarity of behavioral 
information in different expressional modes. Theo- 
retically, it should be possible to define a behavioral- 
classes factor also with tests each of which uses only 
one expressional mode. However, this aspect was not 
adequately represented in this study and so it awaits 
further research. 

Sound Meaning , hypothesised to measure factor CBC, 
was the only test in the present study that used verbal 
labels for behavioral stimuli, although this practice has 
been a prevalent one in social- intelligence research. 
Its loadings in the . 20's on the verbal-comprehension 
and concept-naming factors do not recommend such a 
procedure. 

People vary in their social preferences for either 
two-person or larger groups. The fact that the present 
study isolated two independent ability dimensions, CBR 
and CBS, one dealing with diads and the other with larger 
social systems, may offer a partial explanation for such 
preferences. If an individual understands diadic inter- 
actions better than he does more complex social situa- 
tions, it would not be surprising if he were to prefer 
them. Conversely, if a person prefers diadic relation- 
ships, he might lejarn to understand them better. 

People continually maintain diadic relationships. So, 
the ability reflected by factor CBR is of some importance 
to everyone. However, in intense diads like those in 
marriage or individual psychotherapy, individual dif- 
ferences in this kind of behavioral cognition should be- 
come more apparent. On the other hand, teachers, 
lawyers, and business and political leaders, who must 
understand complex, ongoing social situations, are 
among the professional groups for whom greater CBS 
ability would seem required. 

The behavioral-transformations factor found in this 
analysis reflects the ability to redefine behavioral in- 
formation. In the CBT tests, E must comprehend that 
the same stimulus may have different intentional or 
behavioral meanings. This comprehension is in con- 
trast with that required by the CBC tests, fa the classes 
tests, E must cognise that different behavioral stimuli 
may have the same meaning. 

The tests defining the CBT factor seem to require 
what might be loosely termed flexibility. Tests of such 
flexibility would seem particularly useful in studying 
the neurotic process, in which rigidity of response 
pattern is said to play an important part. 

The loading of Who Said It ? on the CBT factor brings 
humor into the general area of cognition. Who Said R?^ 
reliability is too low to justify future use without revi- 
sion, but humor conceived as dependent upon an intellec- 
tual trait receives some support as a useful hypothesis. 

Being able to predict what other people will do is an 
ability that makes social existence possible. The factor 
CBI defined in this analysis lends support to the long- 
held view that there is a distinct ability involved in 
making predictions of a behavioral nature. 

Many social- intelligence experiments have concen- 
trated mainly on "predictive accuracy. " Factor CBI, 
the ability to make behavioral predictions, suggests 
that these experiments are studying only one of many 
intellectual abilities relevant to the understanding of 
others. By confining experimental effort to but one of 
possibly thirty behavioral abilities, the importance of 



this one ability would seem to be mistakenly over- 
emphasized. 

Limitations of the Behavioral Tests 

Before the behavioral-cognition tests are adopted 
for general use they should be analyzed using populations 
of other kinds. Although the significant correlations 
between socio-economic standing and the behavioral- 
cognition tests might be an artifact due to the presence 
of gifted students in the sample, they might also indicate 
a behavioral-test bias that favors members of the domi- 
nant culture. Such a bias is not necessarily bad. A 
minority-group member should be cognizant of majority 
mores if he is to succeed in the majority culture. This 
possible limitation of the behavioral tests should not be 
overlooked, however. 

As well as further construct validation on special 
groups, including minority groups, the predictive or 
concurrent validity of the behavioral tests must be as- 
certained before their practical usefulness is assumed. 
Should such predictive validation be forthcoming, the 
behavioral tests should be of use in many areas. 

Possible Uses of the Behavioral Tests 

fa studying social intelligence, experimenters could 
use the behavioral- cognition tests to classify their sub- 
jects as being "high" or "low" in social intelligence 
with reference to samples somewhat larger than the 30 
or 40 subjects usually used in such experiments. By 
having available the means of equating the "highs" of 
one experiment with the "highs" of a second experiment, 
some of the previously reported contradictions and in- 
consistencies in social -intelligence research may be 
resolved. 

The behavioral tests might also be used experimen- 
tally as clinical-diagnostic measures or training instru- 
ments. In the latter instance, the improvement of the 
social comprehension of teachers, psychotherapists, 
salesmen, and others who deal with people may well 
benefit the social community at large. 

Contingent upon the demonstration of predictive or 
concurrent validity, the behavioral-cognition tests, which 
tap previously unmeasurable abilities, are promising as 
possible selectors of salesmen, administrators, teachers, 
or others whose jobs require skill in social interactions. 

Recommended Tests 

Each of the following tests ^ is recommended as a 
measure of its respective behavioral factor on the basis 
of its reliability and factor saturation. 



CBU 


Faces 

Expressions 


CBC 


^Expression Grouping 
Picture Exclusion 


CBR 


^Social Relations 
Silhouette Relations 


CBS 


^Missing Pictures 
^Missing Cartoons 


CBT 


♦Picture Exchange 
♦Social Translations 


CBI 


♦Cartoon Predictions 



Q 

7 Revised fornu, of the tests indicated by an aster- 
isk (*) are available for research purposes from Sheridan 
Sipply Company, P. O. Box 837, Beverly Hills, Calif. 
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Some of these recommended tests are neither as 
reliable nor as univocal as is desirable. They are the 
best marker tests presently available, however, for 
their respective factors. 

In determining predictive validity, the tests Missing 
Cartoons and Social Translations would probably be most 
successful. Both of these tests have adequate reliabil- 
ities, and between them five of the six behavioral- 
cognition factors are represented. Missing Cartoons 
is significantly loaded on factors CBU, CBS, and CB1; 
Social Translations , on CBR and CBT. 

Two other tests that might be useful if practically 
valid measures are sought are the factor -pure tests, 
- Depression Grouping (a CBC test) and Cartoon Predic- 
tions (CBI). 

SUMMARY 

Social intelligence has long been thought to exist as 
a unique kind of intellectual ability. However, no tests 
of this ability have been devised that measure other than 
verbal intellectual factors. Okie theory of human intelli- 
gence, Guilford's structure-of-intellect model, hypothe- 
sises not one social intelligence, but thirty different fac- 
tors of behavioral (social) ability. Six of these factors 
are concerned with behavioral cognition or understand- 
ing, the abilities to understand the thoughts, feelings, 
and intentions of other people. These factors correspond 
roughly to the domain termed person perception, empa- 
thy, or social awareness by other investigators. 

In an attempt to measure these six hypothesised 
behavioral- cognition factors, 23 experimental tests were 
constructed. Words were employed as little as possible. 
The stimuli used in most of the tests were photographs, 
realistic drawings, cartoons, silhouettes, stick figures, 
and tape-recorded sentences, sounds, and inflections. 

These 23 tests, as well as 24 marker tests of 12 
previously established factors of semantic and figural 
ability, were administered to 240 eleventh- grade stu- 
dents who were middle -class Caucasians of at least 
average intelligence. 

After iterated-communality estimates were deter- 
mined, 33 principal factors were extracted. The first 
19 of these were analytically rotated to orthogonal simple 
structure, positive manifold, and factor interpretability. 
Eighteen factors, identified as those hypothesized, and 
a residual factor, were obtained. The 12 reference fac- 
tors included 6 semantic or verbal ones: verbal com- 
prehension, verbal classification, verbal relations, 
general reasoning, concept naming, and semantic order- 
ing. Three "creativity" factors, sensitivity to problems, 
ideational fluency, and originality were also isolated. 
Speed of closure, figural inductive reasoning, and flexi- 
bility of closure, three spatial factors, were identified 
as well. In addition, the six hypothesized behavioral- 
cognition factors emerged. 

The factor cognition (C) of behavioral (B) units (U) 
was interpreted as the ability to understand units of ex- 
pression, such as facial expressions. A classes factor 
(CBC) seemed to represent the ability to cognize that 
different modes of expression (gestures, body postures, 
and facial expressions) have the same dispositional 
meaning. A third factor (CBR) was defined primarily 
by tests in which one's understanding of diadic relation- 
ships was assessed. The cognition-of-behavioral sys- 
tems (CBS) factor was interpreted as reflecting the 
ability to comprehend a social situation or sequence of 



events. The transformations or redefinition factor 
(CBT) indicated that the ability to reinterpret either a 
gesture, a facial expression, a statement, or *. whole 
social situation is unique. The sixth behavioral- 
cognition factor, CBI, is concerned with the ability to 
draw implications, to make predictions about what will 
happen following a given social situation. Since this 
predictive -accuracy factor is only one ability, much 
research in social perception that is confined to pre- 
dictions is overly concerned with a narrow range of 
ability when a much broader spectrum exists. 

Construct validity such as the present study has 
provided for the behavioral-intelligence tests does not 
guarantee predictive validity. Obviously, practical 
usefulness depends on the latter. Should predictive 
validity be established, however, these objectively 
scored, reliable, construct -valid tests might serve as 
criterion measures of social intelligence, diagnostic 
techniques in a clinical setting, job-selection instru- 
ments, or training devices, to mention but a few pos- 
sibilities. 
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APPENDIX A 



Description of Variables * 



1# Cartoon Analogies CBR03A. Which alternative expression is related to the third given expression in the same 
way the second given expression is to the first? 



2 . 




Answer: 3. Score: number of items right plus one-third of the number omitted. 
Parts: 2; items per part 4 : 10/15, 12/15; working time: 10 minutes. 





Cartoon Exchange CBT01A 3 . Which alternative, when substituted for the cartoon indicated by the arrow 
change tne meaning of the story by changing the intentions of the characters? 



will 




Answer: 2. 

Score: number of items right plus one-fourth of 
the number omitted. 

Parts: 2; items per part: 12/13, 12/13; 
working t'.me: 16 minutes. 



3. 



4. 



5. 



aUon^howrr^ Cat ^° nB CBI01A ’ which statement describes what happened before, or will happen after the situ- 

1. The man recognized Ferd'nand as a friend. 

2. The salesman will bring a better fitting jacket. 

3. The man, will say how sorry he is. 

4. The man was looking all over for Ferd'nand. 

Answer: 3. Score: number of items right plus one-fourth of the number omitted 
Parts: 2; items per part: 18/18, 16/18; working time: 12 minutes. 

Cartoon Predictions CBI03A. Which alternative situation can be predicted from the given one? 






Answer: 1. Score: number of items right plus one -third of the number omitted. 

Parts: 2; items per part: 15/15, 14/15; working time: 8 minutes. 

Consequences - obvious (DMU) 4 . Write as many different results of an unusual situation as possible. 

Score: one point for each response that would be a direct result of the given situation, including very general 
results. Parts: 4; items per part: 1; working time: 8 minutes. * * 



Drawn and photographed stimuli are 25 to 50 per cent smaller than actual test size. Circled numbers are item 
numbers. 

^Numerator is the number of items scored per part; denominator, the number of items administered. 

Ferd'nand cartoons in tests 2, 3, 18, and 21 used by permission of United Feature Syndicate. 

Tests 5, 6, 23, 35, and 44 were adapted by permission of Sheridan Supply Company, Beverly Hills, California. 

, - 33 
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CoBwqutncM - rwnoU DMT03B. Write as many different results of an unusual situation as possible. 



Score: one point for each response that Indicates an Indirect result or an uncommon adaptation to the given 
situation. Parts: 4; Items per part: 1; working time: 8 minutes. 



7. Differential Aptitude Test - Abstract Reasoning (CFR). Choose the one of five alternative figures that com- 
plete a tour -figure series. 

Score: number of Items right minus' one -fou rth of the number wrong. Scores converted to natlonally-normed 
percentiles. Parts: 1; Items per part: 50; working time: 25 minutes. 



S. 



f. 



Expressions CBU01A. 




Which alternative expresses the same thought, feeling, or Intention as the given? 




Answer: 4. Score: number of Items right plus one-fourth of the number omitted. 

Parts: 2; Items per part: 18/18, 14/18; working time: 10 minutes. 

• Expression Exchange CBT04A., Which alternative facial expression changes the meaning of the gesture?- 




1 2 3 



Answer: 2. Score: number of items right plus one-third of the number omitted. 
Parts: 2; Items per part: 14/15, 14/15; working time: 10 minutes. 



10. Expression Grouping CBC04A. Which alternative expression belongs with the given group of expressions? 



11 . 




Answer: 1. Score: number of Items right plus one-fourth of the number omitted. 
Parts: 2; Items per part: 12/15, 14/15; working time: 10 minutes. 



Faces CBU02A 5 



Which man's face expresses the same feeling or Intention as the woman's? 




Answer: 4. Score: number of Items right plus one-fourth of the number omitted. 
Parts: 2; Items per part: 11/15, 14/15; working time: 8 minutes. 

12. Facial Situations CBS03A. Which situation fits the expressions In both photographs? 

1. He has finally found a job. 

2. They are watching a beauty contest. 

3. The water Is too cold for swimming 

Answer: 2. Score: number of Items right plus one -third of the number omitted. 
Parts: 2; Items per part: 11/15, 10/15; working time: 12 minutes. 




5 Llghtfoot and Frols-Wlttman photographs used In tests 11, 12, and 36 obtained from the Brown University 
Photo Laboratory. 
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Figure Matrix Twt 



0 




0 




0 








? 

a 



CFR02A. Which alternative figure can be eubetituted for the question mark in the matrix? 



0 


0 


O 


O 


0 



a • c e i 



Answer: C. 

Score: number of Items right plus one-third 
of the number omitted. 

Parte: 1; items per part: 7/S; working time: 
3 minutes. 



..I Vrh. UcL^ H ‘ nm<m ' N * ,,0n ™ w °' M *” U1 AblU *- »~»A «r.’ .c.«d « 



Score: number of items right plus one -fifth of the number omitted. 
Parts: 1; items per part: 20/90; working time; 30 minutes. 



Hj flI.. Figure. NFT04A. Which on. of th. Flv. B..lc Flgur.. i. hidd« in th. ..mpl. it.m d.ur.T 




Sample item. 



Answer: 
Parts: 1 



A. Score: number of items right minus one -fourth of the number 
; items per part: 15; working time; 3 minutes. 



wrong. 




rL.,:i wuh *• - * — — — 

NO 




Score: number of items right. Parts: 2; items per part: 13/15, 14/15; working time: 12 minutes. 

Iowa Tests of Educatio nal Development - Quantitative Thinking (CMS). Solve a variety of mathematical problems. 

Score: number of items right. Scores converted to nationally -normed percentiles. 

Parts: 1; items per part: 53; working time: 40 minutes. 



feelings o^tte^haractera?* WWch alternative completes the cartoon strip, making sense of the thoughts and 






Answer: 4. Score: number of items right plus one-fourth of the number omitted. 
Parts: 2; Items per part: 14; working time: 16 minutes. 

98 







19. 



Picture* CBS04A. Which tlttriutlvt completes the story, making sense of the thoughts end feelines of 
the actors? • 




Answer: 3. 

Score: number of items right plus 
one-third of the number omitted. 
Parts: 2; items per part: 11/14, 
10/14; working time: 16 minutes. 



20 . 



Mutilated Words CFU03A . Identify words in which parts of each letter are missing. 

Answer: house. Score: one point for each correct response. 
Parts: 1; items per part: 26; working time: 3 minutes. 



21* Odd Strip Out CBC02A. In which situation does Ferd'nand respond differently than he does in the other two? 




Answer: 2. Score: number of items right plus one-third of the number omitted. 
Parts: 2; items per part: 9/10, 8/10; working time: 12 minutes. 



22. Penetration of Camouflage NFT02A ^ . Circle the human faces camouflaged in the lines of a realistic drawing. 
Score: one point for each correct response. Parts: 1; items per part: 13; working time: 2 minutes. 

2*. Pertinent Questions CMI02B. Write four questions the answers to which would serve as a basis for making a 
decision in a given situation. • 

Score: one point for each correct response. Parts: 1; items per part: 4; working time: 6 minutes. 

29. Picture Arrangement NMS02B ®. Reorder a cartoon strip so that it makes temporal sense. 



— _i_ £ 

Score: one point for each completely correct ordering. Parts: 1; items per part: 8; working time: 3 minutes. 

6 Tests 20, 41, and 4? were adapted by permission from tests by L. L. Thurstone. 

7 Adapted by permission from the Army Air Force test of the same name. 

"Adapted by permission from Dorothy C. Adkins' adaptation of Press Features' cartoon strip LOUIE. 
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25 . 



Picture Exchange 
chtn|« um meaning 



CB^Whlch alternative, whan substituted for Iho picture indicated by 



••■W VW| 








Answer: 
Pa: ts: 2; 



2. Score: number of Items right plus one-third of the number omitted, 
items per part: 9/12, 9/- 12; working time: 16 minutes. 



2 *’ P icture Exclusion CBC05A. Which photographed expression does not belong with the other threat 




Answer: 3. Score: number of items right plus one-fourth of the number omitted. 
Parts: 2, items per part: 10/15; 11/15; working time: 10 minutes. 



27. Picture-Group Naming NMU03A 9. Write a class name for five pictured objects. 




Score: one point for each correct response. Parts: 1; items per part: 9; working time: 2 minutes. 



28. 



Pl ot Titles - low quality DMU05A. Write as many appropriate titles as Doaalble for • .ivn .»,«.♦ 

write aa many clever titles as possible for a seco n T short stor y (Part 2). 1 §t ° ry (Fart 



1 ). 



Score: one point for each title that is relevant but not remote or clever. 
Parts: 2; items per part: 1; working time: 7 minutes. 



29. 



Plot Titles - high quality DM TO IE. Write as 
write as many ciever ~titles as possible for a 



many appropriate titles as possible for a 
second snort story (Part 2). 



given short 



story (Part 1). 



Score: one point for each title that is especially succinct 
Parts: 2; items per part: 1; working time: 7 minutes. 



or clever, or that indicates a reinterpretation of the plot. 



General™ 1 * 34 W#r * adftpted b * lesion of the University of North Carolina and the Office of the Adjutant 
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30. QwiHom II CBU03A*®. Which question might result la the pictured expression t 




© 



1. Can you remember th« first lino of the Constitution? 

2. Don't you think that girl's short skirt Is a scandal? 

3. Isn't that your wife's car? 

4. Did you enjoy your vacation? 



31. 



32. 



33. 



34. 



35. 



36. 



Answer: 2. Score: number of Items right plus one-fourth of the Items omitted. 

Parts: 2; Items per part: 15; working time: 12 minutes. 

Reflections CB104A (auditory)**. Which alternative statement expresses the attitude or feellna underlying the 
g i ve n statem ent? 

Sample Item S. "I'm just wondering how I'll act - I mean how things will turn out. " 

1. She's looking forward to It. 

2. She's worried about it. 

3. She's Interested In how things will work out. 

Answer: 2. Score: number of Items right. Parti: 3; Items per park 6/7, 5/7, 7/7; working time: 10 minutes. 
Seeing Problems CMI03A. Write as many as five problems connected with a common object. 

Sample Item. CANDLE Answers: 1 . 9har 2fr- 4»//; it 



Score: one point f or each problem concerned with the use 
Parts: 1; Items per park 5; working time: 3 minutes. 



i. Jffyiy ut&LL 

, shape, or composition of the given object. 



Seeing Trends I NMU01A. Identify the meaningful trend In a group of words. 

mouse rat lion pig cow horse elephant 



Answer: 






Score: one point for each correct response. Parts: 1; Items per park 10; working time: 3 minutes. 
Sentence Order NMS03B. Arrange three sentences In a meaningful order. 

She bought some food at the market. 

She returned home and cooked some of the food she had bought. 

She went to the market. 



Score: one point for each completely correct ordering. Parts: 1; Items per part: 10; working time: 3 minutes. 

Ship Destination Test CMS02B. Find the distance of a ship to a port, taking Into account the Influence of an In- 
creasing number of variables. 

Score: number of Items right minus one -fourth of the number wrong. 

Parts: 1; Items per park 48; working time: • minutes. 

8llhouette Relations CBR05A**. Which photograph expresses the Individual's feeling or Intention In the sll- 
houette relationship? In part one of the test, the alternative pictures are of men. In part two, they are of women. 




1 2 3 

Answer: 1. Score: number of Items right plus one -third of the number omitted. 
Parts: 2; Items per park 11/15, 12/15; working time: 10 minutes. 



lOFernandel photographs used by permission of Phllllppe Halsman. 

** Items adapted by permission from material of E.H. Porter, Jr., C.R. Rogers, W.U. Snyder, and E.R. Strelch. 
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Silhouettes adapted by permission of R. H. Knapp. 
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37. Social Relations CBR02A 13 . Which statement expresses the foaling of tha Coco Indicator by the arrow, taking 
into account the relationship between tha fhces T 



1) I didn't Ilka that movie vary much. 

2) What a bora.' 

3) Who does ha think ha Is, anyway? 



Answer; 3. Score; number of Items right plus one -third of tha number omitted. 

Parts: 3; Items per part: 3/7, 7/7, 7/7; working time: 6 minutes. 

3t. Social Translations CBT02A. Between which alternative pair will the given statement have a different Intention 
or meaning T 

parent to child 1) teacher to student 

2) student to teacher 
"I don't think so. " 3) student to student 

Answer: 2. Score; number of Items right plus one-third of the number omitted. 

Parts: 2; Items per part: 11/12, 12/12; working time: S minutes. 

39. Sound Meaning CBC06A (auditory). Which one of four words Is the best name for a group of three expressive 
sounds? , 

Score: number of Items right. Parts: 2; Items per park 14/15, 13/15; working time: 14 minutes. 




40. Stick F igure O pposites CBR04A. Which stick figure expresses a feeling or Intention opposite that of the given 
one? 




1 2 3 



Answer: 2. Score: number of Items right plus one-third of the number omitted. 
Parts: 2; Items per park 12/15, 13/15; working time: 8 minutes. 

41. Street Oestalt Completion CFU05A. Identify pictured objects having missing parts. 



Answer: rabbit. 

Score: one point for each correct response. 

Parts: 1; Items per park 24; working time: 3 minutes. 



alternative Is related to the third given word In the same way that the 

eecond given word Is to the first? 

CLOTH : DYE as HOUSE : ? A. shade C. brush 

B. paint D. wood 

Answer: B. Score: number of Items right plus one-fourth of the number omitted. 

Parts: 1; Items per park 12/ 15s working time: 4 minutes. 

43. Verbal Classification CMC02B. Given two classes of four words each, decide whether each of eight different 
words belongs to one class or the other or to neither. 




COW 

HORSE 

OQAT 

BOO 





desk 

sheep 

rocker 

tree 

cat 

nose 

dresser 

donkey 




TABLE 

CHAIR 

BOOKCASE 

LAMP 



Score: number of Items right minus one-half of the number 
wrong. Parts: 1; Items per park 5; working time: 4 minutes. 



h 

“Faces adapted by permission of R. R Knapp. 



44 . 



V erbal Compre h«B»iro CMU02C (Guilford- Zimmerman Aptitude Survey, Part 1). Which one of five alternatives 
BHES same meaning a* a given word? 



Score: number of Items right plus one -fifth of the number omitted. 
Parte: 1; Items per part: 22/24; working time: 4 minutes. 

45. Who Said It? CBT05A* 4 . Which baby's expression fits the caption? 




Answer: 3. Score: number of Items right plus one-fourth of the number omitted. 
Parts: 2; Items per part: 10/12, 10/12; working time: 8 minutes. 



46. Word Classification CMC01A. Which word does not belong with the others? 
Sample Item. A. horse B. cow C. man D. flower 



Answer: D. Score: number of Items right plus one -fourth of the number omitted. 
Parts: 1; Items per parte 16/20; working time: 4 minutes. 

47. Word Matrix Test CMR02A. Which alternative completes the matrix? 



Sample Item. ground 


street 


automobile 


A. 


airplane 


D. 


balloon 


air 


route 




B. 


bird 


E. 


cloud 








C. 


kite 







Answer: A. Score: number of Items right. Parts: 1; Items per part: 10; working time: 3 1/2 minutes. 
48. 8#x. Females were assigned the code value 0; males, 1. 



49. Sibling Status. Only and oldest children were coded 0; others were coded 1. 



50. Socio-Economic Status. Hblllngshead's seven-point Socio-Economic Factor Index was used as follows: 1, execu- 
tives and major professionals; 2, managers and lesser professionals; 3, administrative personnel and seml- 
professiwnals; 4, clerical workers and technicians; 5, skilled manual employees; 6, semi-skilled employees : 
7, unskilled employees. 



51. Mental Age (Henmon-Nelson). This "score" was determined In the manner described In the Henmon-Nelson 
Tests of Mental Ability, Form A manual. 



52. 




Chronological Age. Each examinee's age at the time of testing was determined to the nearest month. 
14 Baby photographs used by permission of Constance Bannister. 
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Target Matrix for Rotated' Factors 
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APPENDIX C 



Construction of Behavioral Divergetat-Production Tests 



The objectives of this research contract included the development of tests for the six factors of behavioral 
divergent production hypothesised by the structure -of- intellect model: divergent production of behavioral units (DBU). 
classes (DBC), relations (DBR), systems (DBS), transformations (DBT), and implications (DBI). Such factors should 
be prominent among abilities important for interpersonal creativity. This phase of the study is based on the results 
of the behavioral-cognition analysis, in which six parallel abilities were demonstrated, and was initiated during the 
final stages of that study. 

Because of the large numbers of examinees demanded by a factor -analytic study, groep testing is a practical 
necessity. Administration of tests to groups severely restricts the kinds of responses examinees can produce Written 
responses, verbal in nature, are usually the most efficient to secure. For this reaeon, most of the DB (divergent - 

production-behavioral) tests constructed to date are of the open-end type that require the examinee to give written res- 
po&Hi. 



One of the findings of the behavioral- cognition phase of this study was further support for the contention that 
verbal material, which stresses semantic information, is not necessarily restricted to that kind of information. We 
have demonstrated that verbal material can be used to communicate behavioral information. However, in testing sit- 
uations where words or other verbal stimuli are used, there is also some danger that semantic variance will be pre- 
wd. Thus, in using verbal response to estimate behavioral ability, great care must be exercised to avoid measuring 
some semantic ability rather than the behavioral ability in which one is interested. 

In developing the DB tests, in which words are used, several precautions were taken in order to minimize 
semantic variance in the tests. These precautions included the following: (1) making the verbal presentations of items 
as simple and as clear as possible; (2) structuring the test task so that the examinees need give only very simple verbal 
responses; (5) extensive training of scorers with respect to thedifference between verbal-behavioral and verbal-semantic 
responses; and most important, (4) the preparation of extensive and explicit scoring guides for each of the DB tests. 

Preliminary forms of 18 behavioral-divergent-production tests have been developed. Twelve of these tests 
have been extensively pretested on four groups of college students (Total N = 120). Certain of these twelve DB tests 
were administered in combination with marker tests for a wide variety of reference factors. The reference factors 
represented were CMU, CMI, CBU, CBC, CBS, CBI, DMU, DMS, and DMT. 

The twelve behavioral tests given are listed and described below, the letters in parentheses indicating their 
hypothesised factor content. A brief description of the factors will serve as a review, as they are more fully set out 
in the body of this report. A Spearman- Brown extension of split-half reliability for each test is in parentheses follow- 
ing the test name. 

DBU Tests. (Divergent-production of behavioral units) The emphasis of these tests is on the generation of 
behavioral units, a behavioral unit being defined as a mental state of a person as manifested by such cues as facial ex- 
pressions or gestures. The four tests given were: 

A. E • dressing Emotion (DBUHr^ = . 84). 

There are four parts to this test, each part naming an emotion of an individual. E is to write as many differ- 
ent things as he can that a person might say if he were feeling the given emotion. 

Sample Item: Write as many things as you can that a person might say if he (or she) were ANGRY. 

Possible Answers: 

1 . I hate you. 

2. Get out. 

3. Grr. 

B. Expression Meaning (DBU)(r^ = . 78).. 

There are two parts to this test, each part describing an action or behavioral gesture of an individual. E is 
to write as many different meanings as he can for the described action. 

Sample Item: If one person winks at another, what could he (or she) be thinking or feeling? 

Possible Answers: 

1. How about a date ? 

2. The person is being friendly. 

3. The person is kidding. 



C. Picture Meanings (DBUMr^ = . 84). 

Thie test consists of three parts, with two items in each part. Each item is a picture of a facial expression 
or a gesture. E is asked to write as many different things as he can that * person might say if he felt as "the person 
in the picture does. " 

D. Sketching Faces (DBU)(r tt = . 88). 

There are four parts to this test, each part describing a situation or event. E is to sketch as many different 
facial expressions as he can to show how the person might feel in the situation. In the scoring of these sketches, an 
attempt is made to score only the expressions suggested, without regard to artistic merit. 

Sample Item: A person who has just realised that he has been robbed. Sketch as many different expressions 

as you can to show how the person might look. 

PBS Tests. (Divergent production of behavioral systems) The emphasis in these tests is upon the generation 
of behavioral systems, where a system can be thought of as a sequence of social behavior or the organisation of actions 
and persons into an interrelated whole. The three tests given were: 

A. Character Combinations (DBS)(r tt = . 65). 

This test consists of four parts, each part consisting of three people who are together in some situation. Each 
person is described in terms of a specific thought, feeling, or attitude. E is asked to make up as many different situa- 
tions as he can to account for the thoughts and feelings of all three characters. 

Sample Item: A - a man in pain, B - a woman who feels sorry, C - an excited man. 

Possible Answers: 

1. B has hit a pedestrian, A, with her car. A witness, C, is shouting at her about her care - 
lessness. 

2. At a ball game, C gets so excited he throws a bottle hitting and hurting an umpire A. C's 
wife, B, doesn't like baseball anyway and is sorry for A. 

B. Diagrammed Social Situations (DBS)(r = . 63). 

Iv 

There are foqr parts to this test, each part being a diagram or map showing the patterns of movement of the 
two people. One person is represented by a solid line, the other by a broken line. Pauses in the movement of these 
two people are also indicated on the diagram. E is to write as many explanations as he can to account for the different 
patterns of movement of the two people in the d’agram. 

C. Possible Plots (DBS)(r w = . 83). 

This test consists of four parts, each part containing the description of a story setting involving three charac- 
ters. Using only these three characters, E is to write as many developments of the given situation as he can. To be 
acceptable, each story must account in different ways for the feelings, thoughts, or emotions of all three characters. 

Sample ltem: Two sisters, A and B, are romantically interested in the same young man, C. One day he 

comes to their house unexpectedly. 

Poxsibty Answers: 

1. A and B praise each other to C who becomes more confused than ever about which one he 
likes better. 

Z. A tells C that B does not want to see him. Instead of discouraging him, this news makes 
C all the more interested in B. 

RB _ T . Teats, (Divergent production of behavioral transformations) In these tests, the emphasis is on the gen - 
(ration of behavioral transformations, a behavioral transformation ’being defined as changes or redefinition of inter- 
personal events. The two tests given were: 

A. Cartoon Completions (DBT)(r^ - . 43). 

This test comsibts of four parts, each part consisting of the first two or three frames in a Ferd'nand cartoon 
strip. E is to write as many different endings as he can for the cartoon strip. To be acceptable, an answer should 
consist of a behavioral response and should make use of the information contained in all of the preceding frames. Also, 
the responses should show a redefinition of the given plot resulting in an unexpected or witty ending. 
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B. Social Solutions (DBT)(r tt = . 87). 

Thi* test consists of six parts, each part briefly outlining a social situation. E is to list as many solutions 
for each situation as he can. The hypothesis underlying this test is that different solutions invlove redefinition of the 
given situation. 

Sample Bern: You are on a weekend trip with a group of friends. Most of them would prefer to spend the day 

hunting but you would prefer to go fishing. You could: 

Possible Answers: 

(4-- 

1. Go hunting with them. 

2. *Tell them to go hunting, while you go fishing. 

3. Convince them they will have more fun fishing. 

PBI Tests. (Divergent production of behavioral impUcations) In the DBI tests, the emphasis is on the gen- 
eration of behavioral implications, a behavioral implication being the extrapolation of information in the form of behav- 
ioral antecedants, expectancies or predictions. The three tests given were: 

V'S» 

A. Paired Expressions. (DBI)(r tt = . 57) 

This test is in three parts, each part consisting of an action of one person, A. E is to write as many responses 
as he can to show how another person, B, might react to A's behavior or expression. 

Sample Item: If person A smiles at person B, what will B do? 

Possible Answers: 

1. Smile back. 

2. Look surprised. 

3. Say, "You're late. " 

4. Be embarrassed. ♦ 

B. Predictions . (DBI)(r^ = . 75) 

This test consists of two parts, each part describing a situation. E is to write as many different results as he 
can for the given situation. 

Sample Item: What possible results might come about if a person has a spot on his (or her) clothes? 

Possible Answers: 

1. Critized by mother. 

2. Feel uneasy. 

3. Be rejected by girl friend. 

C. Social Problems. (DBI)(r^ = . 71) 

This test consists of four parts, each part describing a person in a particular role. E is to write as many dif- 
ferent problems as he can that a person in this social role might have. The responses should indicate problems that 
occur in the person's relationship with others, and should be specific to that particular role. 

Sample Bern: What are the problems a teacher might have in her (or his) relationship with others? 

o Possible Answers: 

1. "Getting along" with people his own age after being around younger ones. 

2. Boring his friends by lecturing to them as he does to his classes. 

3. Knowing what to do with students who "flirt" with him. 

As previously indicated, only a few of the DB tests were administered to all 120 pretesting examinees. Due 
to the small size of pretesting samples, as well as the restricted number of marker tests administered in a given pre- 
testing group, any remarks about the DB tests are necessarily tentative. Even with this precaution in mind, however, 
it would seem that the twelve experimental DB tests are reasonably reliable for experimental purposes. Most of the 
reliability estimates are in the . 70 - . 80 range; inter-scorer reliability is usually greater than . 85. 

With respect to the future factor validity of the DB tests, great caution must accompany interpretations of the 
pretesting data. Since factor analyses are inappropriate, some idea of the clusters formed by the DB tests may be sug- 
gested by inspection of the correlations found among same-factor and different -factor tests. The DBU tests seem to be 
the most highly intercor related of the DB tests constructed to date. The median intercorrelation of three DBU tests is 
. 70. (The test, Sketching Faces, is not at all correlated with the other DBU tests and was not included in the median 
estimate of intercorrelation. ) The median intefrcorrelations of the DBS, DBT, and DBI tests are. respectively, . 44, 

. 44, and . 58. In most cases, these median intra-factor correlations are higher than correlations with tests of any other 
factor, including semantic divergent-production factors. These preliminary findings are most promising, suggesting the 
existence of a unique set of behavioral divergent-production abilities. 




